/ Games of Daze / Infomagic - Games of Daze (Summer 1995) (Disc 1 of 2).iso / x2ftp / msdos / faq / neural.faq

< prev

next >

MacOS 8.1

Win98

DOS

browse contents

view JSON data

view as text

+--------+-------------------------+-------------------------+--------+--------+
|00000000| 50 61 74 68 3a 20 73 65 | 6e 61 74 6f 72 2d 62 65 |Path: se|nator-be|
|00000010| 64 66 65 6c 6c 6f 77 2e | 6d 69 74 2e 65 64 75 21 |dfellow.|mit.edu!|
|00000020| 62 6c 6f 6f 6d 2d 62 65 | 61 63 6f 6e 2e 6d 69 74 |bloom-be|acon.mit|
|00000030| 2e 65 64 75 21 67 61 74 | 65 63 68 21 75 64 65 6c |.edu!gat|ech!udel|
|00000040| 21 6e 65 77 73 2e 6d 61 | 74 68 77 6f 72 6b 73 2e |!news.ma|thworks.|
|00000050| 63 6f 6d 21 75 75 6e 65 | 74 21 69 6e 31 2e 75 75 |com!uune|t!in1.uu|
|00000060| 2e 6e 65 74 21 70 69 70 | 65 78 21 6f 6c 65 61 6e |.net!pip|ex!olean|
|00000070| 65 21 6a 75 73 73 69 65 | 75 2e 66 72 21 75 6e 69 |e!jussie|u.fr!uni|
|00000080| 76 2d 6c 79 6f 6e 31 2e | 66 72 21 73 77 69 64 69 |v-lyon1.|fr!swidi|
|00000090| 72 2e 73 77 69 74 63 68 | 2e 63 68 21 73 63 73 69 |r.switch|.ch!scsi|
|000000a0| 6e 67 2e 73 77 69 74 63 | 68 2e 63 68 21 6e 65 77 |ng.switc|h.ch!new|
|000000b0| 73 2e 64 66 6e 2e 64 65 | 21 67 69 6e 61 2e 7a 66 |s.dfn.de|!gina.zf|
|000000c0| 6e 2e 75 6e 69 2d 62 72 | 65 6d 65 6e 2e 64 65 21 |n.uni-br|emen.de!|
|000000d0| 6d 61 72 76 69 6e 2e 70 | 63 2d 6c 61 62 6f 72 2e |marvin.p|c-labor.|
|000000e0| 75 6e 69 2d 62 72 65 6d | 65 6e 2e 64 65 21 6e 65 |uni-brem|en.de!ne|
|000000f0| 77 73 2e 75 6e 69 2d 73 | 74 75 74 74 67 61 72 74 |ws.uni-s|tuttgart|
|00000100| 2e 64 65 21 72 7a 2e 75 | 6e 69 2d 6b 61 72 6c 73 |.de!rz.u|ni-karls|
|00000110| 72 75 68 65 2e 64 65 21 | 70 72 65 63 68 65 6c 74 |ruhe.de!|prechelt|
|00000120| 0a 46 72 6f 6d 3a 20 70 | 72 65 63 68 65 6c 74 40 |.From: p|rechelt@|
|00000130| 69 72 61 2e 75 6b 61 2e | 64 65 20 28 4c 75 74 7a |ira.uka.|de (Lutz|
|00000140| 20 50 72 65 63 68 65 6c | 74 29 0a 4e 65 77 73 67 | Prechel|t).Newsg|
|00000150| 72 6f 75 70 73 3a 20 63 | 6f 6d 70 2e 61 69 2e 6e |roups: c|omp.ai.n|
|00000160| 65 75 72 61 6c 2d 6e 65 | 74 73 2c 63 6f 6d 70 2e |eural-ne|ts,comp.|
|00000170| 61 6e 73 77 65 72 73 2c | 6e 65 77 73 2e 61 6e 73 |answers,|news.ans|
|00000180| 77 65 72 73 0a 53 75 62 | 6a 65 63 74 3a 20 46 41 |wers.Sub|ject: FA|
|00000190| 51 20 69 6e 20 63 6f 6d | 70 2e 61 69 2e 6e 65 75 |Q in com|p.ai.neu|
|000001a0| 72 61 6c 2d 6e 65 74 73 | 20 2d 2d 20 6d 6f 6e 74 |ral-nets| -- mont|
|000001b0| 68 6c 79 20 70 6f 73 74 | 69 6e 67 0a 53 75 70 65 |hly post|ing.Supe|
|000001c0| 72 73 65 64 65 73 3a 20 | 3c 6e 6e 2e 70 6f 73 74 |rsedes: |<nn.post|
|000001d0| 69 6e 67 5f 37 39 33 39 | 34 31 34 38 32 40 69 34 |ing_7939|41482@i4|
|000001e0| 31 73 32 35 2e 69 72 61 | 2e 75 6b 61 2e 64 65 3e |1s25.ira|.uka.de>|
|000001f0| 0a 46 6f 6c 6c 6f 77 75 | 70 2d 54 6f 3a 20 63 6f |.Followu|p-To: co|
|00000200| 6d 70 2e 61 69 2e 6e 65 | 75 72 61 6c 2d 6e 65 74 |mp.ai.ne|ural-net|
|00000210| 73 0a 44 61 74 65 3a 20 | 32 38 20 4d 61 72 20 31 |s.Date: |28 Mar 1|
|00000220| 39 39 35 20 30 32 3a 31 | 36 3a 34 30 20 47 4d 54 |995 02:1|6:40 GMT|
|00000230| 0a 4f 72 67 61 6e 69 7a | 61 74 69 6f 6e 3a 20 55 |.Organiz|ation: U|
|00000240| 6e 69 76 65 72 73 69 74 | 79 20 6f 66 20 4b 61 72 |niversit|y of Kar|
|00000250| 6c 73 72 75 68 65 2c 20 | 47 65 72 6d 61 6e 79 0a |lsruhe, |Germany.|
|00000260| 4c 69 6e 65 73 3a 20 33 | 34 33 35 0a 41 70 70 72 |Lines: 3|435.Appr|
|00000270| 6f 76 65 64 3a 20 6e 65 | 77 73 2d 61 6e 73 77 65 |oved: ne|ws-answe|
|00000280| 72 73 2d 72 65 71 75 65 | 73 74 40 4d 49 54 2e 45 |rs-reque|st@MIT.E|
|00000290| 64 75 0a 45 78 70 69 72 | 65 73 3a 20 32 20 4d 61 |du.Expir|es: 2 Ma|
|000002a0| 79 20 31 39 39 35 20 30 | 32 3a 31 38 3a 30 33 20 |y 1995 0|2:18:03 |
|000002b0| 47 4d 54 0a 4d 65 73 73 | 61 67 65 2d 49 44 3a 20 |GMT.Mess|age-ID: |
|000002c0| 3c 6e 6e 2e 70 6f 73 74 | 69 6e 67 5f 37 39 36 33 |<nn.post|ing_7963|
|000002d0| 35 37 30 38 33 40 69 34 | 31 73 32 35 2e 69 72 61 |57083@i4|1s25.ira|
|000002e0| 2e 75 6b 61 2e 64 65 3e | 0a 52 65 70 6c 79 2d 54 |.uka.de>|.Reply-T|
|000002f0| 6f 3a 20 70 72 65 63 68 | 65 6c 74 40 69 72 61 2e |o: prech|elt@ira.|
|00000300| 75 6b 61 2e 64 65 20 28 | 4c 75 74 7a 20 50 72 65 |uka.de (|Lutz Pre|
|00000310| 63 68 65 6c 74 29 0a 4e | 4e 54 50 2d 50 6f 73 74 |chelt).N|NTP-Post|
|00000320| 69 6e 67 2d 48 6f 73 74 | 3a 20 69 34 31 73 32 35 |ing-Host|: i41s25|
|00000330| 2e 69 72 61 2e 75 6b 61 | 2e 64 65 0a 4d 69 6d 65 |.ira.uka|.de.Mime|
|00000340| 2d 56 65 72 73 69 6f 6e | 3a 20 31 2e 30 0a 43 6f |-Version|: 1.0.Co|
|00000350| 6e 74 65 6e 74 2d 54 79 | 70 65 3a 20 74 65 78 74 |ntent-Ty|pe: text|
|00000360| 2f 70 6c 61 69 6e 3b 20 | 63 68 61 72 73 65 74 3d |/plain; |charset=|
|00000370| 69 73 6f 2d 38 38 35 39 | 2d 31 0a 43 6f 6e 74 65 |iso-8859|-1.Conte|
|00000380| 6e 74 2d 54 72 61 6e 73 | 66 65 72 2d 45 6e 63 6f |nt-Trans|fer-Enco|
|00000390| 64 69 6e 67 3a 20 38 62 | 69 74 0a 4b 65 79 77 6f |ding: 8b|it.Keywo|
|000003a0| 72 64 73 3a 20 71 75 65 | 73 74 69 6f 6e 73 2c 20 |rds: que|stions, |
|000003b0| 61 6e 73 77 65 72 73 2c | 20 74 65 72 6d 69 6e 6f |answers,| termino|
|000003c0| 6c 6f 67 79 2c 20 62 69 | 62 6c 69 6f 67 72 61 70 |logy, bi|bliograp|
|000003d0| 68 79 0a 4f 72 69 67 69 | 6e 61 74 6f 72 3a 20 70 |hy.Origi|nator: p|
|000003e0| 72 65 63 68 65 6c 74 40 | 69 34 31 73 32 35 0a 58 |rechelt@|i41s25.X|
|000003f0| 72 65 66 3a 20 73 65 6e | 61 74 6f 72 2d 62 65 64 |ref: sen|ator-bed|
|00000400| 66 65 6c 6c 6f 77 2e 6d | 69 74 2e 65 64 75 20 63 |fellow.m|it.edu c|
|00000410| 6f 6d 70 2e 61 69 2e 6e | 65 75 72 61 6c 2d 6e 65 |omp.ai.n|eural-ne|
|00000420| 74 73 3a 32 32 38 38 35 | 20 63 6f 6d 70 2e 61 6e |ts:22885| comp.an|
|00000430| 73 77 65 72 73 3a 31 30 | 38 38 39 20 6e 65 77 73 |swers:10|889 news|
|00000440| 2e 61 6e 73 77 65 72 73 | 3a 34 30 37 38 34 0a 0a |.answers|:40784..|
|00000450| 41 72 63 68 69 76 65 2d | 6e 61 6d 65 3a 20 6e 65 |Archive-|name: ne|
|00000460| 75 72 61 6c 2d 6e 65 74 | 2d 66 61 71 0a 4c 61 73 |ural-net|-faq.Las|
|00000470| 74 2d 6d 6f 64 69 66 69 | 65 64 3a 20 31 39 39 35 |t-modifi|ed: 1995|
|00000480| 2f 30 33 2f 32 33 0a 55 | 52 4c 3a 20 68 74 74 70 |/03/23.U|RL: http|
|00000490| 3a 2f 2f 77 77 77 69 70 | 64 2e 69 72 61 2e 75 6b |://wwwip|d.ira.uk|
|000004a0| 61 2e 64 65 2f 7e 70 72 | 65 63 68 65 6c 74 2f 46 |a.de/~pr|echelt/F|
|000004b0| 41 51 2f 6e 65 75 72 61 | 6c 2d 6e 65 74 2d 66 61 |AQ/neura|l-net-fa|
|000004c0| 71 2e 68 74 6d 6c 0a 4d | 61 69 6e 74 61 69 6e 65 |q.html.M|aintaine|
|000004d0| 72 3a 20 70 72 65 63 68 | 65 6c 74 40 69 72 61 2e |r: prech|elt@ira.|
|000004e0| 75 6b 61 2e 64 65 20 28 | 4c 75 74 7a 20 50 72 65 |uka.de (|Lutz Pre|
|000004f0| 63 68 65 6c 74 29 0a 0a | 0a 20 20 2d 2d 2d 2d 2d |chelt)..|.  -----|
|00000500| 2d 2d 2d 2d 2d 2d 2d 2d | 2d 2d 2d 2d 2d 2d 2d 2d |--------|--------|
|00000510| 2d 2d 2d 2d 2d 2d 2d 2d | 2d 2d 2d 2d 2d 2d 2d 2d |--------|--------|
|00000520| 2d 2d 2d 2d 2d 2d 2d 2d | 2d 2d 2d 2d 2d 2d 2d 2d |--------|--------|
|00000530| 2d 2d 2d 2d 2d 2d 2d 2d | 2d 2d 2d 2d 2d 2d 2d 2d |--------|--------|
|00000540| 2d 2d 2d 0a 20 20 20 20 | 20 20 20 20 41 64 64 69 |---.    |    Addi|
|00000550| 74 69 6f 6e 73 2c 20 63 | 6f 72 72 65 63 74 69 6f |tions, c|orrectio|
|00000560| 6e 73 2c 20 6f 72 20 69 | 6d 70 72 6f 76 65 6d 65 |ns, or i|mproveme|
|00000570| 6e 74 73 20 61 72 65 20 | 61 6c 77 61 79 73 20 77 |nts are |always w|
|00000580| 65 6c 63 6f 6d 65 2e 0a | 20 20 20 20 20 20 20 20 |elcome..|        |
|00000590| 41 6e 79 62 6f 64 79 20 | 77 68 6f 20 69 73 20 77 |Anybody |who is w|
|000005a0| 69 6c 6c 69 6e 67 20 74 | 6f 20 63 6f 6e 74 72 69 |illing t|o contri|
|000005b0| 62 75 74 65 20 61 6e 79 | 20 69 6e 66 6f 72 6d 61 |bute any| informa|
|000005c0| 74 69 6f 6e 2c 0a 20 20 | 20 20 20 20 20 20 70 6c |tion,.  |      pl|
|000005d0| 65 61 73 65 20 65 6d 61 | 69 6c 20 6d 65 3b 20 69 |ease ema|il me; i|
|000005e0| 66 20 69 74 20 69 73 20 | 72 65 6c 65 76 61 6e 74 |f it is |relevant|
|000005f0| 2c 20 49 20 77 69 6c 6c | 20 69 6e 63 6f 72 70 6f |, I will| incorpo|
|00000600| 72 61 74 65 20 69 74 2e | 0a 0a 20 20 20 20 20 20 |rate it.|..      |
|00000610| 20 20 54 68 65 20 6d 6f | 6e 74 68 6c 79 20 70 6f |  The mo|nthly po|
|00000620| 73 74 69 6e 67 20 64 65 | 70 61 72 74 73 20 61 74 |sting de|parts at|
|00000630| 20 74 68 65 20 32 38 74 | 68 20 6f 66 20 65 76 65 | the 28t|h of eve|
|00000640| 72 79 20 6d 6f 6e 74 68 | 2e 0a 20 20 2d 2d 2d 2d |ry month|..  ----|
|00000650| 2d 2d 2d 2d 2d 2d 2d 2d | 2d 2d 2d 2d 2d 2d 2d 2d |--------|--------|
|00000660| 2d 2d 2d 2d 2d 2d 2d 2d | 2d 2d 2d 2d 2d 2d 2d 2d |--------|--------|
|00000670| 2d 2d 2d 2d 2d 2d 2d 2d | 2d 2d 2d 2d 2d 2d 2d 2d |--------|--------|
|00000680| 2d 2d 2d 2d 2d 2d 2d 2d | 2d 2d 2d 2d 2d 2d 2d 2d |--------|--------|
|00000690| 2d 2d 2d 2d 0a 0a 0a 54 | 68 69 73 20 69 73 20 61 |----...T|his is a|
|000006a0| 20 6d 6f 6e 74 68 6c 79 | 20 70 6f 73 74 69 6e 67 | monthly| posting|
|000006b0| 20 74 6f 20 74 68 65 20 | 55 73 65 6e 65 74 20 6e | to the |Usenet n|
|000006c0| 65 77 73 67 72 6f 75 70 | 20 63 6f 6d 70 2e 61 69 |ewsgroup| comp.ai|
|000006d0| 2e 6e 65 75 72 61 6c 2d | 6e 65 74 73 0a 28 61 6e |.neural-|nets.(an|
|000006e0| 64 20 63 6f 6d 70 2e 61 | 6e 73 77 65 72 73 2c 20 |d comp.a|nswers, |
|000006f0| 77 68 65 72 65 20 69 74 | 20 73 68 6f 75 6c 64 20 |where it| should |
|00000700| 62 65 20 66 69 6e 64 61 | 62 6c 65 20 61 74 20 41 |be finda|ble at A|
|00000710| 4e 59 20 74 69 6d 65 29 | 2e 20 49 74 73 0a 70 75 |NY time)|. Its.pu|
|00000720| 72 70 6f 73 65 20 69 73 | 20 74 6f 20 70 72 6f 76 |rpose is| to prov|
|00000730| 69 64 65 20 62 61 73 69 | 63 20 69 6e 66 6f 72 6d |ide basi|c inform|
|00000740| 61 74 69 6f 6e 20 66 6f | 72 20 69 6e 64 69 76 69 |ation fo|r indivi|
|00000750| 64 75 61 6c 73 20 77 68 | 6f 20 61 72 65 20 6e 65 |duals wh|o are ne|
|00000760| 77 20 74 6f 20 74 68 65 | 0a 66 69 65 6c 64 20 6f |w to the|.field o|
|00000770| 66 20 6e 65 75 72 61 6c | 20 6e 65 74 77 6f 72 6b |f neural| network|
|00000780| 73 20 6f 72 20 61 72 65 | 20 6a 75 73 74 20 62 65 |s or are| just be|
|00000790| 67 69 6e 6e 69 6e 67 20 | 74 6f 20 72 65 61 64 20 |ginning |to read |
|000007a0| 74 68 69 73 20 67 72 6f | 75 70 2e 20 49 74 20 73 |this gro|up. It s|
|000007b0| 68 61 6c 6c 0a 68 65 6c | 70 20 74 6f 20 61 76 6f |hall.hel|p to avo|
|000007c0| 69 64 20 6c 65 6e 67 74 | 68 79 20 64 69 73 63 75 |id lengt|hy discu|
|000007d0| 73 73 69 6f 6e 20 6f 66 | 20 71 75 65 73 74 69 6f |ssion of| questio|
|000007e0| 6e 73 20 74 68 61 74 20 | 75 73 75 61 6c 6c 79 20 |ns that |usually |
|000007f0| 61 72 69 73 65 20 66 6f | 72 0a 62 65 67 69 6e 6e |arise fo|r.beginn|
|00000800| 65 72 73 20 6f 66 20 6f | 6e 65 20 6f 72 20 74 68 |ers of o|ne or th|
|00000810| 65 20 6f 74 68 65 72 20 | 6b 69 6e 64 2e 20 0a 0a |e other |kind. ..|
|00000820| 20 20 20 53 4f 2c 20 50 | 4c 45 41 53 45 2c 20 53 |   SO, P|LEASE, S|
|00000830| 45 41 52 43 48 20 54 48 | 49 53 20 50 4f 53 54 49 |EARCH TH|IS POSTI|
|00000840| 4e 47 20 46 49 52 53 54 | 20 49 46 20 59 4f 55 20 |NG FIRST| IF YOU |
|00000850| 48 41 56 45 20 41 20 51 | 55 45 53 54 49 4f 4e 0a |HAVE A Q|UESTION.|
|00000860| 20 20 20 20 20 20 20 20 | 20 20 20 20 20 20 20 20 |        |        |
|00000870| 20 20 20 20 20 20 20 20 | 20 20 20 61 6e 64 0a 20 |        |   and. |
|00000880| 20 20 44 4f 4e 27 54 20 | 50 4f 53 54 20 41 4e 53 |  DON'T |POST ANS|
|00000890| 57 45 52 53 20 54 4f 20 | 46 41 51 73 3a 20 50 4f |WERS TO |FAQs: PO|
|000008a0| 49 4e 54 20 54 48 45 20 | 41 53 4b 45 52 20 54 4f |INT THE |ASKER TO|
|000008b0| 20 54 48 49 53 20 50 4f | 53 54 49 4e 47 0a 0a 54 | THIS PO|STING..T|
|000008c0| 68 69 73 20 70 6f 73 74 | 69 6e 67 20 69 73 20 61 |his post|ing is a|
|000008d0| 72 63 68 69 76 65 64 20 | 69 6e 20 74 68 65 20 70 |rchived |in the p|
|000008e0| 65 72 69 6f 64 69 63 20 | 70 6f 73 74 69 6e 67 20 |eriodic |posting |
|000008f0| 61 72 63 68 69 76 65 20 | 6f 6e 20 68 6f 73 74 0a |archive |on host.|
|00000900| 72 74 66 6d 2e 6d 69 74 | 2e 65 64 75 20 28 61 6e |rtfm.mit|.edu (an|
|00000910| 64 20 6f 6e 20 73 6f 6d | 65 20 6f 74 68 65 72 20 |d on som|e other |
|00000920| 68 6f 73 74 73 20 61 73 | 20 77 65 6c 6c 29 2e 20 |hosts as| well). |
|00000930| 4c 6f 6f 6b 20 69 6e 20 | 74 68 65 20 61 6e 6f 6e |Look in |the anon|
|00000940| 79 6d 6f 75 73 0a 66 74 | 70 20 64 69 72 65 63 74 |ymous.ft|p direct|
|00000950| 6f 72 79 20 22 2f 70 75 | 62 2f 75 73 65 6e 65 74 |ory "/pu|b/usenet|
|00000960| 2f 6e 65 77 73 2e 61 6e | 73 77 65 72 73 22 2c 20 |/news.an|swers", |
|00000970| 74 68 65 20 66 69 6c 65 | 6e 61 6d 65 20 69 73 20 |the file|name is |
|00000980| 61 73 20 67 69 76 65 6e | 20 69 6e 20 74 68 65 0a |as given| in the.|
|00000990| 27 41 72 63 68 69 76 65 | 2d 6e 61 6d 65 3a 27 20 |'Archive|-name:' |
|000009a0| 68 65 61 64 65 72 20 61 | 62 6f 76 65 2e 20 49 66 |header a|bove. If|
|000009b0| 20 79 6f 75 20 64 6f 20 | 6e 6f 74 20 68 61 76 65 | you do |not have|
|000009c0| 20 61 6e 6f 6e 79 6d 6f | 75 73 20 66 74 70 20 61 | anonymo|us ftp a|
|000009d0| 63 63 65 73 73 2c 0a 79 | 6f 75 20 63 61 6e 20 61 |ccess,.y|ou can a|
|000009e0| 63 63 65 73 73 20 74 68 | 65 20 61 72 63 68 69 76 |ccess th|e archiv|
|000009f0| 65 73 20 62 79 20 6d 61 | 69 6c 20 73 65 72 76 65 |es by ma|il serve|
|00000a00| 72 20 61 73 20 77 65 6c | 6c 2e 20 53 65 6e 64 20 |r as wel|l. Send |
|00000a10| 61 6e 20 45 2d 6d 61 69 | 6c 0a 6d 65 73 73 61 67 |an E-mai|l.messag|
|00000a20| 65 20 74 6f 20 6d 61 69 | 6c 2d 73 65 72 76 65 72 |e to mai|l-server|
|00000a30| 40 72 74 66 6d 2e 6d 69 | 74 2e 65 64 75 20 77 69 |@rtfm.mi|t.edu wi|
|00000a40| 74 68 20 22 68 65 6c 70 | 22 20 61 6e 64 20 22 69 |th "help|" and "i|
|00000a50| 6e 64 65 78 22 20 69 6e | 20 74 68 65 0a 62 6f 64 |ndex" in| the.bod|
|00000a60| 79 20 6f 6e 20 73 65 70 | 61 72 61 74 65 20 6c 69 |y on sep|arate li|
|00000a70| 6e 65 73 20 66 6f 72 20 | 6d 6f 72 65 20 69 6e 66 |nes for |more inf|
|00000a80| 6f 72 6d 61 74 69 6f 6e | 2e 0a 0a 46 6f 72 20 74 |ormation|...For t|
|00000a90| 68 6f 73 65 20 6f 66 20 | 79 6f 75 20 77 68 6f 20 |hose of |you who |
|00000aa0| 72 65 61 64 20 74 68 69 | 73 20 70 6f 73 74 69 6e |read thi|s postin|
|00000ab0| 67 20 61 6e 79 77 68 65 | 72 65 20 6f 74 68 65 72 |g anywhe|re other|
|00000ac0| 20 74 68 61 6e 20 69 6e | 0a 63 6f 6d 70 2e 61 69 | than in|.comp.ai|
|00000ad0| 2e 6e 65 75 72 61 6c 2d | 6e 65 74 73 3a 20 54 6f |.neural-|nets: To|
|00000ae0| 20 72 65 61 64 20 63 6f | 6d 70 2e 61 69 2e 6e 65 | read co|mp.ai.ne|
|00000af0| 75 72 61 6c 2d 6e 65 74 | 73 20 28 6f 72 20 70 6f |ural-net|s (or po|
|00000b00| 73 74 20 61 72 74 69 63 | 6c 65 73 20 74 6f 20 69 |st artic|les to i|
|00000b10| 74 29 0a 79 6f 75 20 6e | 65 65 64 20 55 73 65 6e |t).you n|eed Usen|
|00000b20| 65 74 20 4e 65 77 73 20 | 61 63 63 65 73 73 2e 20 |et News |access. |
|00000b30| 54 72 79 20 74 68 65 20 | 63 6f 6d 6d 61 6e 64 73 |Try the |commands|
|00000b40| 2c 20 27 78 72 6e 27 2c | 20 27 72 6e 27 2c 20 27 |, 'xrn',| 'rn', '|
|00000b50| 6e 6e 27 2c 20 6f 72 20 | 27 74 72 6e 27 0a 6f 6e |nn', or |'trn'.on|
|00000b60| 20 79 6f 75 72 20 55 6e | 69 78 20 6d 61 63 68 69 | your Un|ix machi|
|00000b70| 6e 65 2c 20 27 6e 65 77 | 73 27 20 6f 6e 20 79 6f |ne, 'new|s' on yo|
|00000b80| 75 72 20 56 4d 53 20 6d | 61 63 68 69 6e 65 2c 20 |ur VMS m|achine, |
|00000b90| 6f 72 20 61 73 6b 20 61 | 20 6c 6f 63 61 6c 0a 67 |or ask a| local.g|
|00000ba0| 75 72 75 2e 0a 0a 54 68 | 69 73 20 6d 6f 6e 74 68 |uru...Th|is month|
|00000bb0| 6c 79 20 70 6f 73 74 69 | 6e 67 20 69 73 20 61 6c |ly posti|ng is al|
|00000bc0| 73 6f 20 61 76 61 69 6c | 61 62 6c 65 20 61 73 20 |so avail|able as |
|00000bd0| 61 20 68 79 70 65 72 74 | 65 78 74 20 64 6f 63 75 |a hypert|ext docu|
|00000be0| 6d 65 6e 74 20 69 6e 20 | 57 57 57 0a 28 57 6f 72 |ment in |WWW.(Wor|
|00000bf0| 6c 64 20 57 69 64 65 20 | 57 65 62 29 20 75 6e 64 |ld Wide |Web) und|
|00000c00| 65 72 20 74 68 65 20 55 | 52 4c 20 0a 22 68 74 74 |er the U|RL ."htt|
|00000c10| 70 3a 2f 2f 77 77 77 69 | 70 64 2e 69 72 61 2e 75 |p://wwwi|pd.ira.u|
|00000c20| 6b 61 2e 64 65 2f 7e 70 | 72 65 63 68 65 6c 74 2f |ka.de/~p|rechelt/|
|00000c30| 46 41 51 2f 6e 65 75 72 | 61 6c 2d 6e 65 74 2d 66 |FAQ/neur|al-net-f|
|00000c40| 61 71 2e 68 74 6d 6c 22 | 0a 0a 54 68 65 20 6d 6f |aq.html"|..The mo|
|00000c50| 6e 74 68 6c 79 20 70 6f | 73 74 69 6e 67 20 69 73 |nthly po|sting is|
|00000c60| 20 6e 6f 74 20 6d 65 61 | 6e 74 20 74 6f 20 64 69 | not mea|nt to di|
|00000c70| 73 63 75 73 73 20 61 6e | 79 20 74 6f 70 69 63 20 |scuss an|y topic |
|00000c80| 65 78 68 61 75 73 74 69 | 76 65 6c 79 2e 0a 0a 44 |exhausti|vely...D|
|00000c90| 69 73 63 6c 61 69 6d 65 | 72 3a 20 0a 20 20 20 54 |isclaime|r: .   T|
|00000ca0| 68 69 73 20 70 6f 73 74 | 69 6e 67 20 69 73 20 70 |his post|ing is p|
|00000cb0| 72 6f 76 69 64 65 64 20 | 27 61 73 20 69 73 27 2e |rovided |'as is'.|
|00000cc0| 0a 20 20 20 4e 6f 20 77 | 61 72 72 61 6e 74 79 20 |.   No w|arranty |
|00000cd0| 77 68 61 74 73 6f 65 76 | 65 72 20 69 73 20 65 78 |whatsoev|er is ex|
|00000ce0| 70 72 65 73 73 65 64 20 | 6f 72 20 69 6d 70 6c 69 |pressed |or impli|
|00000cf0| 65 64 2c 20 0a 20 20 20 | 69 6e 20 70 61 72 74 69 |ed, .   |in parti|
|00000d00| 63 75 6c 61 72 2c 20 6e | 6f 20 77 61 72 72 61 6e |cular, n|o warran|
|00000d10| 74 79 20 74 68 61 74 20 | 74 68 65 20 69 6e 66 6f |ty that |the info|
|00000d20| 72 6d 61 74 69 6f 6e 20 | 63 6f 6e 74 61 69 6e 65 |rmation |containe|
|00000d30| 64 20 68 65 72 65 69 6e | 0a 20 20 20 69 73 20 63 |d herein|.   is c|
|00000d40| 6f 72 72 65 63 74 20 6f | 72 20 75 73 65 66 75 6c |orrect o|r useful|
|00000d50| 20 69 6e 20 61 6e 79 20 | 77 61 79 2c 20 61 6c 74 | in any |way, alt|
|00000d60| 68 6f 75 67 68 20 62 6f | 74 68 20 69 73 20 69 6e |hough bo|th is in|
|00000d70| 74 65 6e 64 65 64 2e 0a | 0a 54 6f 20 66 69 6e 64 |tended..|.To find|
|00000d80| 20 74 68 65 20 61 6e 73 | 77 65 72 20 6f 66 20 71 | the ans|wer of q|
|00000d90| 75 65 73 74 69 6f 6e 20 | 6e 75 6d 62 65 72 20 27 |uestion |number '|
|00000da0| 78 27 2c 20 73 65 61 72 | 63 68 20 66 6f 72 20 74 |x', sear|ch for t|
|00000db0| 68 65 20 73 74 72 69 6e | 67 0a 22 78 2e 20 41 3a |he strin|g."x. A:|
|00000dc0| 22 20 28 73 6f 20 74 68 | 65 20 61 6e 73 77 65 72 |" (so th|e answer|
|00000dd0| 20 74 6f 20 71 75 65 73 | 74 69 6f 6e 20 31 32 20 | to ques|tion 12 |
|00000de0| 69 73 20 61 74 20 20 20 | 31 32 2e 20 41 3a 20 20 |is at   |12. A:  |
|00000df0| 29 0a 0a 0a 41 6e 64 20 | 6e 6f 77 2c 20 69 6e 20 |)...And |now, in |
|00000e00| 74 68 65 20 65 6e 64 2c | 20 77 65 20 62 65 67 69 |the end,| we begi|
|00000e10| 6e 3a 20 0a 0a 3d 3d 3d | 3d 3d 3d 3d 3d 3d 3d 20 |n: ..===|======= |
|00000e20| 51 75 65 73 74 69 6f 6e | 73 20 3d 3d 3d 3d 3d 3d |Question|s ======|
|00000e30| 3d 3d 3d 3d 20 0a 2a 2a | 2a 2a 2a 2a 2a 2a 2a 2a |==== .**|********|
|00000e40| 2a 2a 2a 2a 2a 2a 2a 2a | 2a 2a 2a 2a 2a 2a 2a 2a |********|********|
|00000e50| 2a 2a 2a 2a 2a 2a 0a 0a | 20 31 2e 20 57 68 61 74 |******..| 1. What|
|00000e60| 20 69 73 20 74 68 69 73 | 20 6e 65 77 73 67 72 6f | is this| newsgro|
|00000e70| 75 70 20 66 6f 72 3f 20 | 48 6f 77 20 73 68 61 6c |up for? |How shal|
|00000e80| 6c 20 69 74 20 62 65 20 | 75 73 65 64 3f 20 0a 20 |l it be |used? . |
|00000e90| 32 2e 20 57 68 61 74 20 | 69 73 20 61 20 6e 65 75 |2. What |is a neu|
|00000ea0| 72 61 6c 20 6e 65 74 77 | 6f 72 6b 20 28 4e 4e 29 |ral netw|ork (NN)|
|00000eb0| 3f 20 0a 20 33 2e 20 57 | 68 61 74 20 63 61 6e 20 |? . 3. W|hat can |
|00000ec0| 79 6f 75 20 64 6f 20 77 | 69 74 68 20 61 20 4e 65 |you do w|ith a Ne|
|00000ed0| 75 72 61 6c 20 4e 65 74 | 77 6f 72 6b 20 61 6e 64 |ural Net|work and|
|00000ee0| 20 77 68 61 74 20 6e 6f | 74 3f 20 0a 20 34 2e 20 | what no|t? . 4. |
|00000ef0| 57 68 6f 20 69 73 20 63 | 6f 6e 63 65 72 6e 65 64 |Who is c|oncerned|
|00000f00| 20 77 69 74 68 20 4e 65 | 75 72 61 6c 20 4e 65 74 | with Ne|ural Net|
|00000f10| 77 6f 72 6b 73 3f 20 0a | 0a 20 35 2e 20 57 68 61 |works? .|. 5. Wha|
|00000f20| 74 20 64 6f 65 73 20 27 | 62 61 63 6b 70 72 6f 70 |t does '|backprop|
|00000f30| 27 20 6d 65 61 6e 3f 20 | 57 68 61 74 20 69 73 20 |' mean? |What is |
|00000f40| 27 6f 76 65 72 66 69 74 | 74 69 6e 67 27 3f 20 0a |'overfit|ting'? .|
|00000f50| 20 36 2e 20 57 68 79 20 | 75 73 65 20 61 20 62 69 | 6. Why |use a bi|
|00000f60| 61 73 20 69 6e 70 75 74 | 3f 20 57 68 79 20 61 63 |as input|? Why ac|
|00000f70| 74 69 76 61 74 69 6f 6e | 20 66 75 6e 63 74 69 6f |tivation| functio|
|00000f80| 6e 73 3f 20 0a 20 37 2e | 20 48 6f 77 20 6d 61 6e |ns? . 7.| How man|
|00000f90| 79 20 68 69 64 64 65 6e | 20 75 6e 69 74 73 20 73 |y hidden| units s|
|00000fa0| 68 6f 75 6c 64 20 49 20 | 75 73 65 3f 20 0a 20 38 |hould I |use? . 8|
|00000fb0| 2e 20 48 6f 77 20 6d 61 | 6e 79 20 6c 65 61 72 6e |. How ma|ny learn|
|00000fc0| 69 6e 67 20 6d 65 74 68 | 6f 64 73 20 66 6f 72 20 |ing meth|ods for |
|00000fd0| 4e 4e 73 20 65 78 69 73 | 74 3f 20 57 68 69 63 68 |NNs exis|t? Which|
|00000fe0| 3f 20 0a 20 39 2e 20 57 | 68 61 74 20 61 62 6f 75 |? . 9. W|hat abou|
|00000ff0| 74 20 47 65 6e 65 74 69 | 63 20 41 6c 67 6f 72 69 |t Geneti|c Algori|
|00001000| 74 68 6d 73 3f 20 0a 20 | 31 30 2e 20 57 68 61 74 |thms? . |10. What|
|00001010| 20 61 62 6f 75 74 20 46 | 75 7a 7a 79 20 4c 6f 67 | about F|uzzy Log|
|00001020| 69 63 3f 20 0a 20 31 31 | 2e 20 48 6f 77 20 61 72 |ic? . 11|. How ar|
|00001030| 65 20 4e 4e 73 20 72 65 | 6c 61 74 65 64 20 74 6f |e NNs re|lated to|
|00001040| 20 73 74 61 74 69 73 74 | 69 63 61 6c 20 6d 65 74 | statist|ical met|
|00001050| 68 6f 64 73 3f 20 0a 0a | 20 31 32 2e 20 47 6f 6f |hods? ..| 12. Goo|
|00001060| 64 20 69 6e 74 72 6f 64 | 75 63 74 6f 72 79 20 6c |d introd|uctory l|
|00001070| 69 74 65 72 61 74 75 72 | 65 20 61 62 6f 75 74 20 |iteratur|e about |
|00001080| 4e 65 75 72 61 6c 20 4e | 65 74 77 6f 72 6b 73 3f |Neural N|etworks?|
|00001090| 20 0a 20 31 33 2e 20 41 | 6e 79 20 6a 6f 75 72 6e | . 13. A|ny journ|
|000010a0| 61 6c 73 20 61 6e 64 20 | 6d 61 67 61 7a 69 6e 65 |als and |magazine|
|000010b0| 73 20 61 62 6f 75 74 20 | 4e 65 75 72 61 6c 20 4e |s about |Neural N|
|000010c0| 65 74 77 6f 72 6b 73 3f | 20 0a 20 31 34 2e 20 54 |etworks?| . 14. T|
|000010d0| 68 65 20 6d 6f 73 74 20 | 69 6d 70 6f 72 74 61 6e |he most |importan|
|000010e0| 74 20 63 6f 6e 66 65 72 | 65 6e 63 65 73 20 63 6f |t confer|ences co|
|000010f0| 6e 63 65 72 6e 65 64 20 | 77 69 74 68 20 4e 65 75 |ncerned |with Neu|
|00001100| 72 61 6c 0a 20 20 20 4e | 65 74 77 6f 72 6b 73 3f |ral.   N|etworks?|
|00001110| 20 0a 20 31 35 2e 20 4e | 65 75 72 61 6c 20 4e 65 | . 15. N|eural Ne|
|00001120| 74 77 6f 72 6b 20 41 73 | 73 6f 63 69 61 74 69 6f |twork As|sociatio|
|00001130| 6e 73 3f 20 0a 20 31 36 | 2e 20 4f 74 68 65 72 20 |ns? . 16|. Other |
|00001140| 73 6f 75 72 63 65 73 20 | 6f 66 20 69 6e 66 6f 72 |sources |of infor|
|00001150| 6d 61 74 69 6f 6e 20 61 | 62 6f 75 74 20 4e 4e 73 |mation a|bout NNs|
|00001160| 3f 20 0a 0a 20 31 37 2e | 20 46 72 65 65 6c 79 20 |? .. 17.| Freely |
|00001170| 61 76 61 69 6c 61 62 6c | 65 20 73 6f 66 74 77 61 |availabl|e softwa|
|00001180| 72 65 20 70 61 63 6b 61 | 67 65 73 20 66 6f 72 20 |re packa|ges for |
|00001190| 4e 4e 20 73 69 6d 75 6c | 61 74 69 6f 6e 3f 20 0a |NN simul|ation? .|
|000011a0| 20 31 38 2e 20 43 6f 6d | 6d 65 72 63 69 61 6c 20 | 18. Com|mercial |
|000011b0| 73 6f 66 74 77 61 72 65 | 20 70 61 63 6b 61 67 65 |software| package|
|000011c0| 73 20 66 6f 72 20 4e 4e | 20 73 69 6d 75 6c 61 74 |s for NN| simulat|
|000011d0| 69 6f 6e 3f 20 0a 20 31 | 39 2e 20 4e 65 75 72 61 |ion? . 1|9. Neura|
|000011e0| 6c 20 4e 65 74 77 6f 72 | 6b 20 68 61 72 64 77 61 |l Networ|k hardwa|
|000011f0| 72 65 3f 20 0a 0a 20 32 | 30 2e 20 44 61 74 61 62 |re? .. 2|0. Datab|
|00001200| 61 73 65 73 20 66 6f 72 | 20 65 78 70 65 72 69 6d |ases for| experim|
|00001210| 65 6e 74 61 74 69 6f 6e | 20 77 69 74 68 20 4e 4e |entation| with NN|
|00001220| 73 3f 20 0a 0a 3d 3d 3d | 3d 3d 3d 3d 3d 3d 3d 20 |s? ..===|======= |
|00001230| 41 6e 73 77 65 72 73 20 | 3d 3d 3d 3d 3d 3d 3d 3d |Answers |========|
|00001240| 3d 3d 20 0a 2a 2a 2a 2a | 2a 2a 2a 2a 2a 2a 2a 2a |== .****|********|
|00001250| 2a 2a 2a 2a 2a 2a 2a 2a | 2a 2a 2a 2a 2a 2a 2a 2a |********|********|
|00001260| 2a 2a 0a 0a 20 31 2e 20 | 41 3a 20 57 68 61 74 20 |**.. 1. |A: What |
|00001270| 69 73 20 74 68 69 73 20 | 6e 65 77 73 67 72 6f 75 |is this |newsgrou|
|00001280| 70 20 66 6f 72 3f 20 48 | 6f 77 20 73 68 61 6c 6c |p for? H|ow shall|
|00001290| 20 69 74 20 62 65 0a 20 | 3d 3d 3d 3d 3d 3d 3d 3d | it be. |========|
|000012a0| 3d 3d 3d 3d 3d 3d 3d 3d | 3d 3d 3d 3d 3d 3d 3d 3d |========|========|
|000012b0| 3d 3d 3d 3d 3d 3d 3d 3d | 3d 3d 3d 3d 3d 3d 3d 3d |========|========|
|000012c0| 3d 3d 3d 3d 3d 3d 3d 3d | 3d 0a 20 20 20 75 73 65 |========|=.   use|
|000012d0| 64 3f 0a 20 20 20 3d 3d | 3d 3d 3d 0a 0a 20 20 20 |d?.   ==|===..   |
|000012e0| 54 68 65 20 6e 65 77 73 | 67 72 6f 75 70 20 63 6f |The news|group co|
|000012f0| 6d 70 2e 61 69 2e 6e 65 | 75 72 61 6c 2d 6e 65 74 |mp.ai.ne|ural-net|
|00001300| 73 20 69 73 20 69 6e 74 | 65 64 65 64 20 61 73 20 |s is int|eded as |
|00001310| 61 20 66 6f 72 75 6d 20 | 66 6f 72 0a 20 20 20 70 |a forum |for.   p|
|00001320| 65 6f 70 6c 65 20 77 68 | 6f 20 77 61 6e 74 20 74 |eople wh|o want t|
|00001330| 6f 20 75 73 65 20 6f 72 | 20 65 78 70 6c 6f 72 65 |o use or| explore|
|00001340| 20 74 68 65 20 63 61 70 | 61 62 69 6c 69 74 69 65 | the cap|abilitie|
|00001350| 73 20 6f 66 20 41 72 74 | 69 66 69 63 69 61 6c 0a |s of Art|ificial.|
|00001360| 20 20 20 4e 65 75 72 61 | 6c 20 4e 65 74 77 6f 72 |   Neura|l Networ|
|00001370| 6b 73 20 6f 72 20 4e 65 | 75 72 61 6c 2d 4e 65 74 |ks or Ne|ural-Net|
|00001380| 77 6f 72 6b 2d 6c 69 6b | 65 20 73 74 72 75 63 74 |work-lik|e struct|
|00001390| 75 72 65 73 2e 0a 0a 20 | 20 20 54 68 65 72 65 20 |ures... |  There |
|000013a0| 73 68 6f 75 6c 64 20 62 | 65 20 74 68 65 20 66 6f |should b|e the fo|
|000013b0| 6c 6c 6f 77 69 6e 67 20 | 74 79 70 65 73 20 6f 66 |llowing |types of|
|000013c0| 20 61 72 74 69 63 6c 65 | 73 20 69 6e 20 74 68 69 | article|s in thi|
|000013d0| 73 20 6e 65 77 73 67 72 | 6f 75 70 3a 0a 0a 20 20 |s newsgr|oup:..  |
|000013e0| 20 20 31 2e 20 52 65 71 | 75 65 73 74 73 0a 20 20 |  1. Req|uests.  |
|000013f0| 20 20 2b 2b 2b 2b 2b 2b | 2b 2b 2b 2b 2b 0a 0a 20 |  ++++++|+++++.. |
|00001400| 20 20 20 20 20 52 65 71 | 75 65 73 74 73 20 61 72 |     Req|uests ar|
|00001410| 65 20 61 72 74 69 63 6c | 65 73 20 6f 66 20 74 68 |e articl|es of th|
|00001420| 65 20 66 6f 72 6d 20 22 | 49 20 61 6d 20 6c 6f 6f |e form "|I am loo|
|00001430| 6b 69 6e 67 20 66 6f 72 | 0a 20 20 20 20 20 20 58 |king for|.      X|
|00001440| 22 20 77 68 65 72 65 20 | 58 20 69 73 20 73 6f 6d |" where |X is som|
|00001450| 65 74 68 69 6e 67 20 70 | 75 62 6c 69 63 20 6c 69 |ething p|ublic li|
|00001460| 6b 65 20 61 20 62 6f 6f | 6b 2c 20 61 6e 20 61 72 |ke a boo|k, an ar|
|00001470| 74 69 63 6c 65 2c 20 61 | 0a 20 20 20 20 20 20 70 |ticle, a|.      p|
|00001480| 69 65 63 65 20 6f 66 20 | 73 6f 66 74 77 61 72 65 |iece of |software|
|00001490| 2e 20 54 68 65 20 6d 6f | 73 74 20 69 6d 70 6f 72 |. The mo|st impor|
|000014a0| 74 61 6e 74 20 61 62 6f | 75 74 20 73 75 63 68 20 |tant abo|ut such |
|000014b0| 61 20 72 65 71 75 65 73 | 74 0a 20 20 20 20 20 20 |a reques|t.      |
|000014c0| 69 73 20 74 6f 20 62 65 | 20 61 73 20 73 70 65 63 |is to be| as spec|
|000014d0| 69 66 69 63 20 61 73 20 | 70 6f 73 73 69 62 6c 65 |ific as |possible|
|000014e0| 21 0a 0a 20 20 20 20 20 | 20 49 66 20 6d 75 6c 74 |!..     | If mult|
|000014f0| 69 70 6c 65 20 64 69 66 | 66 65 72 65 6e 74 20 61 |iple dif|ferent a|
|00001500| 6e 73 77 65 72 73 20 63 | 61 6e 20 62 65 20 65 78 |nswers c|an be ex|
|00001510| 70 65 63 74 65 64 2c 20 | 74 68 65 20 70 65 72 73 |pected, |the pers|
|00001520| 6f 6e 0a 20 20 20 20 20 | 20 6d 61 6b 69 6e 67 20 |on.     | making |
|00001530| 74 68 65 20 72 65 71 75 | 65 73 74 20 73 68 6f 75 |the requ|est shou|
|00001540| 6c 64 20 70 72 65 70 61 | 72 65 20 74 6f 20 6d 61 |ld prepa|re to ma|
|00001550| 6b 65 20 61 20 73 75 6d | 6d 61 72 79 20 6f 66 0a |ke a sum|mary of.|
|00001560| 20 20 20 20 20 20 74 68 | 65 20 61 6e 73 77 65 72 |      th|e answer|
|00001570| 73 20 68 65 2f 73 68 65 | 20 67 6f 74 20 61 6e 64 |s he/she| got and|
|00001580| 20 61 6e 6e 6f 75 6e 63 | 65 20 74 6f 20 64 6f 20 | announc|e to do |
|00001590| 73 6f 20 77 69 74 68 20 | 61 0a 20 20 20 20 20 20 |so with |a.      |
|000015a0| 70 68 72 61 73 65 20 6c | 69 6b 65 20 22 50 6c 65 |phrase l|ike "Ple|
|000015b0| 61 73 65 20 72 65 70 6c | 79 20 62 79 20 65 6d 61 |ase repl|y by ema|
|000015c0| 69 6c 2c 20 49 27 6c 6c | 0a 20 20 20 20 20 20 73 |il, I'll|.      s|
|000015d0| 75 6d 6d 61 72 69 7a 65 | 20 74 6f 20 74 68 65 20 |ummarize| to the |
|000015e0| 67 72 6f 75 70 22 20 61 | 74 20 74 68 65 20 65 6e |group" a|t the en|
|000015f0| 64 20 6f 66 20 74 68 65 | 20 70 6f 73 74 69 6e 67 |d of the| posting|
|00001600| 2e 0a 0a 20 20 20 20 20 | 20 54 68 65 20 53 75 62 |...     | The Sub|
|00001610| 6a 65 63 74 20 6c 69 6e | 65 20 6f 66 20 74 68 65 |ject lin|e of the|
|00001620| 20 70 6f 73 74 69 6e 67 | 20 73 68 6f 75 6c 64 20 | posting| should |
|00001630| 74 68 65 6e 20 62 65 20 | 73 6f 6d 65 74 68 69 6e |then be |somethin|
|00001640| 67 0a 20 20 20 20 20 20 | 6c 69 6b 65 20 22 52 65 |g.      |like "Re|
|00001650| 71 75 65 73 74 3a 20 58 | 22 20 0a 0a 20 20 20 20 |quest: X|" ..    |
|00001660| 32 2e 20 51 75 65 73 74 | 69 6f 6e 73 0a 20 20 20 |2. Quest|ions.   |
|00001670| 20 2b 2b 2b 2b 2b 2b 2b | 2b 2b 2b 2b 2b 0a 0a 20 | +++++++|+++++.. |
|00001680| 20 20 20 20 20 41 73 20 | 6f 70 70 6f 73 65 64 20 |     As |opposed |
|00001690| 74 6f 20 72 65 71 75 65 | 73 74 73 2c 20 71 75 65 |to reque|sts, que|
|000016a0| 73 74 69 6f 6e 73 20 61 | 73 6b 20 66 6f 72 20 61 |stions a|sk for a|
|000016b0| 20 6c 61 72 67 65 72 20 | 70 69 65 63 65 20 6f 66 | larger |piece of|
|000016c0| 0a 20 20 20 20 20 20 69 | 6e 66 6f 72 6d 61 74 69 |.      i|nformati|
|000016d0| 6f 6e 20 6f 72 20 61 20 | 6d 6f 72 65 20 6f 72 20 |on or a |more or |
|000016e0| 6c 65 73 73 20 64 65 74 | 61 69 6c 65 64 20 65 78 |less det|ailed ex|
|000016f0| 70 6c 61 6e 61 74 69 6f | 6e 20 6f 66 0a 20 20 20 |planatio|n of.   |
|00001700| 20 20 20 73 6f 6d 65 74 | 68 69 6e 67 2e 20 54 6f |   somet|hing. To|
|00001710| 20 61 76 6f 69 64 20 6c | 6f 74 73 20 6f 66 20 72 | avoid l|ots of r|
|00001720| 65 64 75 6e 64 61 6e 74 | 20 74 72 61 66 66 69 63 |edundant| traffic|
|00001730| 20 69 74 20 69 73 20 69 | 6d 70 6f 72 74 61 6e 74 | it is i|mportant|
|00001740| 0a 20 20 20 20 20 20 74 | 68 61 74 20 74 68 65 20 |.      t|hat the |
|00001750| 70 6f 73 74 65 72 20 70 | 72 6f 76 69 64 65 73 20 |poster p|rovides |
|00001760| 77 69 74 68 20 74 68 65 | 20 71 75 65 73 74 69 6f |with the| questio|
|00001770| 6e 20 61 6c 6c 20 69 6e | 66 6f 72 6d 61 74 69 6f |n all in|formatio|
|00001780| 6e 0a 20 20 20 20 20 20 | 73 2f 68 65 20 61 6c 72 |n.      |s/he alr|
|00001790| 65 61 64 79 20 68 61 73 | 20 61 62 6f 75 74 20 74 |eady has| about t|
|000017a0| 68 65 20 73 75 62 6a 65 | 63 74 20 61 73 6b 65 64 |he subje|ct asked|
|000017b0| 20 61 6e 64 20 73 74 61 | 74 65 20 74 68 65 0a 20 | and sta|te the. |
|000017c0| 20 20 20 20 20 61 63 74 | 75 61 6c 20 71 75 65 73 |     act|ual ques|
|000017d0| 74 69 6f 6e 20 61 73 20 | 70 72 65 63 69 73 65 20 |tion as |precise |
|000017e0| 61 6e 64 20 6e 61 72 72 | 6f 77 20 61 73 20 70 6f |and narr|ow as po|
|000017f0| 73 73 69 62 6c 65 2e 20 | 54 68 65 0a 20 20 20 20 |ssible. |The.    |
|00001800| 20 20 70 6f 73 74 65 72 | 20 73 68 6f 75 6c 64 20 |  poster| should |
|00001810| 70 72 65 70 61 72 65 20 | 74 6f 20 6d 61 6b 65 20 |prepare |to make |
|00001820| 61 20 73 75 6d 6d 61 72 | 79 20 6f 66 20 74 68 65 |a summar|y of the|
|00001830| 20 61 6e 73 77 65 72 73 | 0a 20 20 20 20 20 20 73 | answers|.      s|
|00001840| 2f 68 65 20 67 6f 74 20 | 61 6e 64 20 61 6e 6e 6f |/he got |and anno|
|00001850| 75 6e 63 65 20 74 6f 20 | 64 6f 20 73 6f 20 77 69 |unce to |do so wi|
|00001860| 74 68 20 61 20 70 68 72 | 61 73 65 20 6c 69 6b 65 |th a phr|ase like|
|00001870| 20 0a 20 20 20 20 20 20 | 22 50 6c 65 61 73 65 20 | .      |"Please |
|00001880| 72 65 70 6c 79 20 62 79 | 20 65 6d 61 69 6c 2c 20 |reply by| email, |
|00001890| 49 27 6c 6c 20 73 75 6d | 6d 61 72 69 7a 65 20 74 |I'll sum|marize t|
|000018a0| 6f 0a 20 20 20 20 20 20 | 74 68 65 20 67 72 6f 75 |o.      |the grou|
|000018b0| 70 22 20 61 74 20 74 68 | 65 20 65 6e 64 20 6f 66 |p" at th|e end of|
|000018c0| 20 74 68 65 20 70 6f 73 | 74 69 6e 67 2e 0a 0a 20 | the pos|ting... |
|000018d0| 20 20 20 20 20 54 68 65 | 20 53 75 62 6a 65 63 74 |     The| Subject|
|000018e0| 20 6c 69 6e 65 20 6f 66 | 20 74 68 65 20 70 6f 73 | line of| the pos|
|000018f0| 74 69 6e 67 20 73 68 6f | 75 6c 64 20 62 65 20 73 |ting sho|uld be s|
|00001900| 6f 6d 65 74 68 69 6e 67 | 20 6c 69 6b 65 20 0a 20 |omething| like . |
|00001910| 20 20 20 20 20 22 51 75 | 65 73 74 69 6f 6e 3a 20 |     "Qu|estion: |
|00001920| 74 68 69 73 2d 61 6e 64 | 2d 74 68 61 74 22 20 6f |this-and|-that" o|
|00001930| 72 20 68 61 76 65 20 74 | 68 65 20 66 6f 72 6d 20 |r have t|he form |
|00001940| 6f 66 20 61 0a 20 20 20 | 20 20 20 71 75 65 73 74 |of a.   |   quest|
|00001950| 69 6f 6e 20 28 69 2e 65 | 2e 2c 20 65 6e 64 20 77 |ion (i.e|., end w|
|00001960| 69 74 68 20 61 20 71 75 | 65 73 74 69 6f 6e 20 6d |ith a qu|estion m|
|00001970| 61 72 6b 29 20 0a 0a 20 | 20 20 20 33 2e 20 41 6e |ark) .. |   3. An|
|00001980| 73 77 65 72 73 0a 20 20 | 20 20 2b 2b 2b 2b 2b 2b |swers.  |  ++++++|
|00001990| 2b 2b 2b 2b 0a 0a 20 20 | 20 20 20 20 54 68 65 73 |++++..  |    Thes|
|000019a0| 65 20 61 72 65 20 72 65 | 61 63 74 69 6f 6e 73 20 |e are re|actions |
|000019b0| 74 6f 20 71 75 65 73 74 | 69 6f 6e 73 20 6f 72 20 |to quest|ions or |
|000019c0| 72 65 71 75 65 73 74 73 | 2e 20 41 73 20 61 20 72 |requests|. As a r|
|000019d0| 75 6c 65 20 6f 66 0a 20 | 20 20 20 20 20 74 68 75 |ule of. |     thu|
|000019e0| 6d 62 20 61 72 74 69 63 | 6c 65 73 20 6f 66 20 74 |mb artic|les of t|
|000019f0| 79 70 65 20 22 61 6e 73 | 77 65 72 22 20 73 68 6f |ype "ans|wer" sho|
|00001a00| 75 6c 64 20 62 65 20 72 | 61 72 65 2e 20 49 64 65 |uld be r|are. Ide|
|00001a10| 61 6c 6c 79 2c 20 69 6e | 0a 20 20 20 20 20 20 6d |ally, in|.      m|
|00001a20| 6f 73 74 20 63 61 73 65 | 73 20 65 69 74 68 65 72 |ost case|s either|
|00001a30| 20 74 68 65 20 61 6e 73 | 77 65 72 20 69 73 20 74 | the ans|wer is t|
|00001a40| 6f 6f 20 73 70 65 63 69 | 66 69 63 20 74 6f 20 62 |oo speci|fic to b|
|00001a50| 65 20 6f 66 20 67 65 6e | 65 72 61 6c 0a 20 20 20 |e of gen|eral.   |
|00001a60| 20 20 20 69 6e 74 65 72 | 65 73 74 20 28 61 6e 64 |   inter|est (and|
|00001a70| 20 73 68 6f 75 6c 64 20 | 74 68 75 73 20 62 65 20 | should |thus be |
|00001a80| 65 2d 6d 61 69 6c 65 64 | 20 74 6f 20 74 68 65 20 |e-mailed| to the |
|00001a90| 70 6f 73 74 65 72 29 20 | 6f 72 20 61 0a 20 20 20 |poster) |or a.   |
|00001aa0| 20 20 20 73 75 6d 6d 61 | 72 79 20 77 61 73 20 61 |   summa|ry was a|
|00001ab0| 6e 6e 6f 75 6e 63 65 64 | 20 77 69 74 68 20 74 68 |nnounced| with th|
|00001ac0| 65 20 71 75 65 73 74 69 | 6f 6e 20 6f 72 20 72 65 |e questi|on or re|
|00001ad0| 71 75 65 73 74 20 28 61 | 6e 64 0a 20 20 20 20 20 |quest (a|nd.     |
|00001ae0| 20 61 6e 73 77 65 72 73 | 20 73 68 6f 75 6c 64 20 | answers| should |
|00001af0| 74 68 75 73 20 62 65 20 | 65 2d 6d 61 69 6c 65 64 |thus be |e-mailed|
|00001b00| 20 74 6f 20 74 68 65 20 | 70 6f 73 74 65 72 29 2e | to the |poster).|
|00001b10| 0a 0a 20 20 20 20 20 20 | 54 68 65 20 73 75 62 6a |..      |The subj|
|00001b20| 65 63 74 20 6c 69 6e 65 | 73 20 6f 66 20 61 6e 73 |ect line|s of ans|
|00001b30| 77 65 72 73 20 61 72 65 | 20 61 75 74 6f 6d 61 74 |wers are| automat|
|00001b40| 69 63 61 6c 6c 79 20 61 | 64 6a 75 73 74 65 64 20 |ically a|djusted |
|00001b50| 62 79 0a 20 20 20 20 20 | 20 74 68 65 20 6e 65 77 |by.     | the new|
|00001b60| 73 20 73 6f 66 74 77 61 | 72 65 2e 20 4e 6f 74 65 |s softwa|re. Note|
|00001b70| 20 74 68 61 74 20 73 6f | 6d 65 74 69 6d 65 73 20 | that so|metimes |
|00001b80| 6c 6f 6e 67 65 72 20 74 | 68 72 65 61 64 73 20 6f |longer t|hreads o|
|00001b90| 66 0a 20 20 20 20 20 20 | 64 69 73 63 75 73 73 69 |f.      |discussi|
|00001ba0| 6f 6e 20 65 76 6f 6c 76 | 65 20 66 72 6f 6d 20 61 |on evolv|e from a|
|00001bb0| 6e 20 61 6e 73 77 65 72 | 20 74 6f 20 61 20 71 75 |n answer| to a qu|
|00001bc0| 65 73 74 69 6f 6e 20 6f | 72 20 72 65 71 75 65 73 |estion o|r reques|
|00001bd0| 74 2e 0a 20 20 20 20 20 | 20 49 6e 20 74 68 69 73 |t..     | In this|
|00001be0| 20 63 61 73 65 20 70 6f | 73 74 65 72 73 20 73 68 | case po|sters sh|
|00001bf0| 6f 75 6c 64 20 63 68 61 | 6e 67 65 20 74 68 65 20 |ould cha|nge the |
|00001c00| 73 75 62 6a 65 63 74 20 | 6c 69 6e 65 20 73 75 69 |subject |line sui|
|00001c10| 74 61 62 6c 79 0a 20 20 | 20 20 20 20 61 73 20 73 |tably.  |    as s|
|00001c20| 6f 6f 6e 20 61 73 20 74 | 68 65 20 74 6f 70 69 63 |oon as t|he topic|
|00001c30| 20 67 6f 65 73 20 74 6f | 6f 20 66 61 72 20 61 77 | goes to|o far aw|
|00001c40| 61 79 20 66 72 6f 6d 20 | 74 68 65 20 6f 6e 65 0a |ay from |the one.|
|00001c50| 20 20 20 20 20 20 61 6e | 6e 6f 75 6e 63 65 64 20 |      an|nounced |
|00001c60| 69 6e 20 74 68 65 20 6f | 72 69 67 69 6e 61 6c 20 |in the o|riginal |
|00001c70| 73 75 62 6a 65 63 74 20 | 6c 69 6e 65 2e 20 59 6f |subject |line. Yo|
|00001c80| 75 20 63 61 6e 20 73 74 | 69 6c 6c 20 63 61 72 72 |u can st|ill carr|
|00001c90| 79 0a 20 20 20 20 20 20 | 61 6c 6f 6e 67 20 74 68 |y.      |along th|
|00001ca0| 65 20 6f 6c 64 20 73 75 | 62 6a 65 63 74 20 69 6e |e old su|bject in|
|00001cb0| 20 70 61 72 65 6e 74 68 | 65 73 65 73 20 69 6e 20 | parenth|eses in |
|00001cc0| 74 68 65 20 66 6f 72 6d | 20 0a 20 20 20 20 20 20 |the form| .      |
|00001cd0| 22 53 75 62 6a 65 63 74 | 3a 20 6e 65 77 20 73 75 |"Subject|: new su|
|00001ce0| 62 6a 65 63 74 20 28 77 | 61 73 3a 20 6f 6c 64 20 |bject (w|as: old |
|00001cf0| 73 75 62 6a 65 63 74 29 | 22 20 0a 0a 20 20 20 20 |subject)|" ..    |
|00001d00| 34 2e 20 53 75 6d 6d 61 | 72 69 65 73 0a 20 20 20 |4. Summa|ries.   |
|00001d10| 20 2b 2b 2b 2b 2b 2b 2b | 2b 2b 2b 2b 2b 0a 0a 20 | +++++++|+++++.. |
|00001d20| 20 20 20 20 20 49 6e 20 | 61 6c 6c 20 63 61 73 65 |     In |all case|
|00001d30| 73 20 6f 66 20 72 65 71 | 75 65 73 74 73 20 6f 72 |s of req|uests or|
|00001d40| 20 71 75 65 73 74 69 6f | 6e 73 20 74 68 65 20 61 | questio|ns the a|
|00001d50| 6e 73 77 65 72 73 20 66 | 6f 72 20 77 68 69 63 68 |nswers f|or which|
|00001d60| 0a 20 20 20 20 20 20 63 | 61 6e 20 62 65 20 61 73 |.      c|an be as|
|00001d70| 73 75 6d 65 64 20 74 6f | 20 62 65 20 6f 66 20 73 |sumed to| be of s|
|00001d80| 6f 6d 65 20 67 65 6e 65 | 72 61 6c 20 69 6e 74 65 |ome gene|ral inte|
|00001d90| 72 65 73 74 2c 20 74 68 | 65 20 70 6f 73 74 65 72 |rest, th|e poster|
|00001da0| 20 6f 66 0a 20 20 20 20 | 20 20 74 68 65 20 72 65 | of.    |  the re|
|00001db0| 71 75 65 73 74 20 6f 72 | 20 71 75 65 73 74 69 6f |quest or| questio|
|00001dc0| 6e 20 73 68 61 6c 6c 20 | 73 75 6d 6d 61 72 69 7a |n shall |summariz|
|00001dd0| 65 20 74 68 65 20 61 6e | 73 77 65 72 73 20 68 65 |e the an|swers he|
|00001de0| 2f 73 68 65 0a 20 20 20 | 20 20 20 72 65 63 65 69 |/she.   |   recei|
|00001df0| 76 65 64 2e 20 53 75 63 | 68 20 61 20 73 75 6d 6d |ved. Suc|h a summ|
|00001e00| 61 72 79 20 73 68 6f 75 | 6c 64 20 62 65 20 61 6e |ary shou|ld be an|
|00001e10| 6e 6f 75 6e 63 65 64 20 | 69 6e 20 74 68 65 0a 20 |nounced |in the. |
|00001e20| 20 20 20 20 20 6f 72 69 | 67 69 6e 61 6c 20 70 6f |     ori|ginal po|
|00001e30| 73 74 69 6e 67 20 6f 66 | 20 74 68 65 20 71 75 65 |sting of| the que|
|00001e40| 73 74 69 6f 6e 20 6f 72 | 20 72 65 71 75 65 73 74 |stion or| request|
|00001e50| 20 77 69 74 68 20 61 20 | 70 68 72 61 73 65 0a 20 | with a |phrase. |
|00001e60| 20 20 20 20 20 6c 69 6b | 65 20 22 50 6c 65 61 73 |     lik|e "Pleas|
|00001e70| 65 20 61 6e 73 77 65 72 | 20 62 79 20 65 6d 61 69 |e answer| by emai|
|00001e80| 6c 2c 20 49 27 6c 6c 0a | 20 20 20 20 20 20 73 75 |l, I'll.|      su|
|00001e90| 6d 6d 61 72 69 7a 65 22 | 0a 0a 20 20 20 20 20 20 |mmarize"|..      |
|00001ea0| 49 6e 20 73 75 63 68 20 | 61 20 63 61 73 65 2c 20 |In such |a case, |
|00001eb0| 70 65 6f 70 6c 65 20 77 | 68 6f 20 61 6e 73 77 65 |people w|ho answe|
|00001ec0| 72 20 74 6f 20 61 20 71 | 75 65 73 74 69 6f 6e 20 |r to a q|uestion |
|00001ed0| 73 68 6f 75 6c 64 0a 20 | 20 20 20 20 20 4e 4f 54 |should. |     NOT|
|00001ee0| 20 70 6f 73 74 20 74 68 | 65 69 72 20 61 6e 73 77 | post th|eir answ|
|00001ef0| 65 72 20 74 6f 20 74 68 | 65 20 6e 65 77 73 67 72 |er to th|e newsgr|
|00001f00| 6f 75 70 20 62 75 74 20 | 69 6e 73 74 65 61 64 20 |oup but |instead |
|00001f10| 6d 61 69 6c 0a 20 20 20 | 20 20 20 74 68 65 6d 20 |mail.   |   them |
|00001f20| 74 6f 20 74 68 65 20 70 | 6f 73 74 65 72 20 6f 66 |to the p|oster of|
|00001f30| 20 74 68 65 20 71 75 65 | 73 74 69 6f 6e 20 77 68 | the que|stion wh|
|00001f40| 6f 20 63 6f 6c 6c 65 63 | 74 73 20 61 6e 64 20 72 |o collec|ts and r|
|00001f50| 65 76 69 65 77 73 0a 20 | 20 20 20 20 20 74 68 65 |eviews. |     the|
|00001f60| 6d 2e 20 41 66 74 65 72 | 20 61 62 6f 75 74 20 35 |m. After| about 5|
|00001f70| 20 74 6f 20 32 30 20 64 | 61 79 73 20 61 66 74 65 | to 20 d|ays afte|
|00001f80| 72 20 74 68 65 20 6f 72 | 69 67 69 6e 61 6c 20 70 |r the or|iginal p|
|00001f90| 6f 73 74 69 6e 67 2c 20 | 69 74 73 0a 20 20 20 20 |osting, |its.    |
|00001fa0| 20 20 70 6f 73 74 65 72 | 20 73 68 6f 75 6c 64 20 |  poster| should |
|00001fb0| 6d 61 6b 65 20 74 68 65 | 20 73 75 6d 6d 61 72 79 |make the| summary|
|00001fc0| 20 6f 66 20 61 6e 73 77 | 65 72 73 20 61 6e 64 20 | of answ|ers and |
|00001fd0| 70 6f 73 74 20 69 74 20 | 74 6f 0a 20 20 20 20 20 |post it |to.     |
|00001fe0| 20 74 68 65 20 6e 65 77 | 73 67 72 6f 75 70 2e 0a | the new|sgroup..|
|00001ff0| 0a 20 20 20 20 20 20 53 | 6f 6d 65 20 63 61 72 65 |.      S|ome care|
|00002000| 20 73 68 6f 75 6c 64 20 | 62 65 20 69 6e 76 65 73 | should |be inves|
|00002010| 74 65 64 20 69 6e 74 6f | 20 61 20 73 75 6d 6d 61 |ted into| a summa|
|00002020| 72 79 3a 20 0a 20 20 20 | 20 20 20 20 6f 20 73 69 |ry: .   |    o si|
|00002030| 6d 70 6c 65 20 63 6f 6e | 63 61 74 65 6e 61 74 69 |mple con|catenati|
|00002040| 6f 6e 20 6f 66 20 61 6c | 6c 20 74 68 65 20 61 6e |on of al|l the an|
|00002050| 73 77 65 72 73 20 69 73 | 20 6e 6f 74 0a 20 20 20 |swers is| not.   |
|00002060| 20 20 20 20 20 20 65 6e | 6f 75 67 68 3a 20 69 6e |      en|ough: in|
|00002070| 73 74 65 61 64 2c 20 72 | 65 64 75 6e 64 61 6e 63 |stead, r|edundanc|
|00002080| 69 65 73 2c 20 69 72 72 | 65 6c 65 76 61 6e 63 69 |ies, irr|elevanci|
|00002090| 65 73 2c 0a 20 20 20 20 | 20 20 20 20 20 76 65 72 |es,.    |     ver|
|000020a0| 62 6f 73 69 74 69 65 73 | 2c 20 61 6e 64 20 65 72 |bosities|, and er|
|000020b0| 72 6f 72 73 20 73 68 6f | 75 6c 64 20 62 65 20 66 |rors sho|uld be f|
|000020c0| 69 6c 74 65 72 65 64 20 | 6f 75 74 20 28 61 73 20 |iltered |out (as |
|000020d0| 67 6f 6f 64 0a 20 20 20 | 20 20 20 20 20 20 61 73 |good.   |      as|
|000020e0| 20 70 6f 73 73 69 62 6c | 65 29 20 0a 20 20 20 20 | possibl|e) .    |
|000020f0| 20 20 20 6f 20 74 68 65 | 20 61 6e 73 77 65 72 73 |   o the| answers|
|00002100| 20 73 68 6f 75 6c 64 20 | 62 65 20 73 65 70 61 72 | should |be separ|
|00002110| 61 74 65 64 20 63 6c 65 | 61 72 6c 79 20 0a 20 20 |ated cle|arly .  |
|00002120| 20 20 20 20 20 6f 20 74 | 68 65 20 63 6f 6e 74 72 |     o t|he contr|
|00002130| 69 62 75 74 6f 72 73 20 | 6f 66 20 74 68 65 20 69 |ibutors |of the i|
|00002140| 6e 64 69 76 69 64 75 61 | 6c 20 61 6e 73 77 65 72 |ndividua|l answer|
|00002150| 73 20 73 68 6f 75 6c 64 | 20 62 65 0a 20 20 20 20 |s should| be.    |
|00002160| 20 20 20 20 20 69 64 65 | 6e 74 69 66 69 61 62 6c |     ide|ntifiabl|
|00002170| 65 20 28 75 6e 6c 65 73 | 73 20 74 68 65 79 20 72 |e (unles|s they r|
|00002180| 65 71 75 65 73 74 65 64 | 20 74 6f 20 72 65 6d 61 |equested| to rema|
|00002190| 69 6e 0a 20 20 20 20 20 | 20 20 20 20 61 6e 6f 6e |in.     |    anon|
|000021a0| 79 6d 6f 75 73 20 5b 79 | 65 73 2c 20 74 68 61 74 |ymous [y|es, that|
|000021b0| 20 68 61 70 70 65 6e 73 | 5d 29 20 0a 20 20 20 20 | happens|]) .    |
|000021c0| 20 20 20 6f 20 74 68 65 | 20 73 75 6d 6d 61 72 79 |   o the| summary|
|000021d0| 20 73 68 6f 75 6c 64 20 | 73 74 61 72 74 20 77 69 | should |start wi|
|000021e0| 74 68 20 74 68 65 20 22 | 71 75 69 6e 74 65 73 73 |th the "|quintess|
|000021f0| 65 6e 63 65 22 20 6f 66 | 0a 20 20 20 20 20 20 20 |ence" of|.       |
|00002200| 20 20 74 68 65 20 61 6e | 73 77 65 72 73 2c 20 61 |  the an|swers, a|
|00002210| 73 20 73 65 65 6e 20 62 | 79 20 74 68 65 20 6f 72 |s seen b|y the or|
|00002220| 69 67 69 6e 61 6c 20 70 | 6f 73 74 65 72 20 0a 20 |iginal p|oster . |
|00002230| 20 20 20 20 20 20 6f 20 | 41 20 73 75 6d 6d 61 72 |      o |A summar|
|00002240| 79 20 73 68 6f 75 6c 64 | 2c 20 77 68 65 6e 20 70 |y should|, when p|
|00002250| 6f 73 74 65 64 2c 20 63 | 6c 65 61 72 6c 79 20 62 |osted, c|learly b|
|00002260| 65 0a 20 20 20 20 20 20 | 20 20 20 69 6e 64 69 63 |e.      |   indic|
|00002270| 61 74 65 64 20 74 6f 20 | 62 65 20 6f 6e 65 20 62 |ated to |be one b|
|00002280| 79 20 67 69 76 69 6e 67 | 20 69 74 20 61 20 53 75 |y giving| it a Su|
|00002290| 62 6a 65 63 74 20 6c 69 | 6e 65 0a 20 20 20 20 20 |bject li|ne.     |
|000022a0| 20 20 20 20 73 74 61 72 | 74 69 6e 67 20 77 69 74 |    star|ting wit|
|000022b0| 68 20 22 53 55 4d 4d 41 | 52 59 3a 22 20 0a 20 20 |h "SUMMA|RY:" .  |
|000022c0| 20 20 20 20 4e 6f 74 65 | 20 74 68 61 74 20 61 20 |    Note| that a |
|000022d0| 67 6f 6f 64 20 73 75 6d | 6d 61 72 79 20 69 73 20 |good sum|mary is |
|000022e0| 70 75 72 65 20 67 6f 6c | 64 20 66 6f 72 20 74 68 |pure gol|d for th|
|000022f0| 65 20 72 65 73 74 20 6f | 66 20 74 68 65 0a 20 20 |e rest o|f the.  |
|00002300| 20 20 20 20 6e 65 77 73 | 67 72 6f 75 70 20 63 6f |    news|group co|
|00002310| 6d 6d 75 6e 69 74 79 2c | 20 73 6f 20 73 75 6d 6d |mmunity,| so summ|
|00002320| 61 72 79 20 77 6f 72 6b | 20 77 69 6c 6c 20 62 65 |ary work| will be|
|00002330| 20 6d 6f 73 74 0a 20 20 | 20 20 20 20 61 70 70 72 | most.  |    appr|
|00002340| 65 63 69 61 74 65 64 20 | 62 79 20 61 6c 6c 20 6f |eciated |by all o|
|00002350| 66 20 75 73 2e 20 47 6f | 6f 64 20 73 75 6d 6d 61 |f us. Go|od summa|
|00002360| 72 69 65 73 20 61 72 65 | 20 6d 6f 72 65 20 76 61 |ries are| more va|
|00002370| 6c 75 61 62 6c 65 0a 20 | 20 20 20 20 20 74 68 61 |luable. |     tha|
|00002380| 6e 20 61 6e 79 20 6d 6f | 64 65 72 61 74 6f 72 20 |n any mo|derator |
|00002390| 21 20 3a 2d 29 20 0a 0a | 20 20 20 20 35 2e 20 41 |! :-) ..|    5. A|
|000023a0| 6e 6e 6f 75 6e 63 65 6d | 65 6e 74 73 0a 20 20 20 |nnouncem|ents.   |
|000023b0| 20 2b 2b 2b 2b 2b 2b 2b | 2b 2b 2b 2b 2b 2b 2b 2b | +++++++|++++++++|
|000023c0| 2b 0a 0a 20 20 20 20 20 | 20 53 6f 6d 65 20 61 72 |+..     | Some ar|
|000023d0| 74 69 63 6c 65 73 20 6e | 65 76 65 72 20 6e 65 65 |ticles n|ever nee|
|000023e0| 64 20 61 6e 79 20 70 75 | 62 6c 69 63 20 72 65 61 |d any pu|blic rea|
|000023f0| 63 74 69 6f 6e 2e 20 54 | 68 65 73 65 20 61 72 65 |ction. T|hese are|
|00002400| 0a 20 20 20 20 20 20 63 | 61 6c 6c 65 64 20 61 6e |.      c|alled an|
|00002410| 6e 6f 75 6e 63 65 6d 65 | 6e 74 73 20 28 66 6f 72 |nounceme|nts (for|
|00002420| 20 69 6e 73 74 61 6e 63 | 65 20 66 6f 72 20 61 20 | instanc|e for a |
|00002430| 77 6f 72 6b 73 68 6f 70 | 2c 0a 20 20 20 20 20 20 |workshop|,.      |
|00002440| 63 6f 6e 66 65 72 65 6e | 63 65 20 6f 72 20 74 68 |conferen|ce or th|
|00002450| 65 20 61 76 61 69 6c 61 | 62 69 6c 69 74 79 20 6f |e availa|bility o|
|00002460| 66 20 73 6f 6d 65 20 74 | 65 63 68 6e 69 63 61 6c |f some t|echnical|
|00002470| 20 72 65 70 6f 72 74 20 | 6f 72 0a 20 20 20 20 20 | report |or.     |
|00002480| 20 73 6f 66 74 77 61 72 | 65 20 73 79 73 74 65 6d | softwar|e system|
|00002490| 29 2e 0a 0a 20 20 20 20 | 20 20 41 6e 6e 6f 75 6e |)...    |  Announ|
|000024a0| 63 65 6d 65 6e 74 73 20 | 73 68 6f 75 6c 64 20 62 |cements |should b|
|000024b0| 65 20 63 6c 65 61 72 6c | 79 20 69 6e 64 69 63 61 |e clearl|y indica|
|000024c0| 74 65 64 20 74 6f 20 62 | 65 20 73 75 63 68 20 62 |ted to b|e such b|
|000024d0| 79 0a 20 20 20 20 20 20 | 67 69 76 69 6e 67 20 74 |y.      |giving t|
|000024e0| 68 65 6d 20 61 20 73 75 | 62 6a 65 63 74 20 6c 69 |hem a su|bject li|
|000024f0| 6e 65 20 6f 66 20 74 68 | 65 20 66 6f 72 6d 20 22 |ne of th|e form "|
|00002500| 41 6e 6e 6f 75 6e 63 65 | 6d 65 6e 74 3a 0a 20 20 |Announce|ment:.  |
|00002510| 20 20 20 20 74 68 69 73 | 2d 61 6e 64 2d 74 68 61 |    this|-and-tha|
|00002520| 74 22 20 0a 0a 20 20 20 | 20 36 2e 20 52 65 70 6f |t" ..   | 6. Repo|
|00002530| 72 74 73 0a 20 20 20 20 | 2b 2b 2b 2b 2b 2b 2b 2b |rts.    |++++++++|
|00002540| 2b 2b 0a 0a 20 20 20 20 | 20 20 53 6f 6d 65 74 69 |++..    |  Someti|
|00002550| 6d 65 73 20 70 65 6f 70 | 6c 65 20 73 70 6f 6e 74 |mes peop|le spont|
|00002560| 61 6e 65 6f 75 73 6c 79 | 20 77 61 6e 74 20 74 6f |aneously| want to|
|00002570| 20 72 65 70 6f 72 74 20 | 73 6f 6d 65 74 68 69 6e | report |somethin|
|00002580| 67 0a 20 20 20 20 20 20 | 74 6f 20 74 68 65 20 6e |g.      |to the n|
|00002590| 65 77 73 67 72 6f 75 70 | 2e 20 54 68 69 73 20 6d |ewsgroup|. This m|
|000025a0| 69 67 68 74 20 62 65 20 | 73 70 65 63 69 61 6c 20 |ight be |special |
|000025b0| 65 78 70 65 72 69 65 6e | 63 65 73 20 77 69 74 68 |experien|ces with|
|000025c0| 0a 20 20 20 20 20 20 73 | 6f 6d 65 20 73 6f 66 74 |.      s|ome soft|
|000025d0| 77 61 72 65 2c 20 72 65 | 73 75 6c 74 73 20 6f 66 |ware, re|sults of|
|000025e0| 20 6f 77 6e 20 65 78 70 | 65 72 69 6d 65 6e 74 73 | own exp|eriments|
|000025f0| 20 6f 72 20 63 6f 6e 63 | 65 70 74 75 61 6c 0a 20 | or conc|eptual. |
|00002600| 20 20 20 20 20 77 6f 72 | 6b 2c 20 6f 72 20 65 73 |     wor|k, or es|
|00002610| 70 65 63 69 61 6c 6c 79 | 20 69 6e 74 65 72 65 73 |pecially| interes|
|00002620| 74 69 6e 67 20 69 6e 66 | 6f 72 6d 61 74 69 6f 6e |ting inf|ormation|
|00002630| 20 66 72 6f 6d 0a 20 20 | 20 20 20 20 73 6f 6d 65 | from.  |    some|
|00002640| 77 68 65 72 65 20 65 6c | 73 65 2e 0a 0a 20 20 20 |where el|se...   |
|00002650| 20 20 20 52 65 70 6f 72 | 74 73 20 73 68 6f 75 6c |   Repor|ts shoul|
|00002660| 64 20 62 65 20 63 6c 65 | 61 72 6c 79 20 69 6e 64 |d be cle|arly ind|
|00002670| 69 63 61 74 65 64 20 74 | 6f 20 62 65 20 73 75 63 |icated t|o be suc|
|00002680| 68 20 62 79 20 67 69 76 | 69 6e 67 0a 20 20 20 20 |h by giv|ing.    |
|00002690| 20 20 74 68 65 6d 20 61 | 20 73 75 62 6a 65 63 74 |  them a| subject|
|000026a0| 20 6c 69 6e 65 20 6f 66 | 20 74 68 65 20 66 6f 72 | line of| the for|
|000026b0| 6d 20 22 52 65 70 6f 72 | 74 3a 0a 20 20 20 20 20 |m "Repor|t:.     |
|000026c0| 20 74 68 69 73 2d 61 6e | 64 2d 74 68 61 74 22 20 | this-an|d-that" |
|000026d0| 0a 0a 20 20 20 20 37 2e | 20 44 69 73 63 75 73 73 |..    7.| Discuss|
|000026e0| 69 6f 6e 73 0a 20 20 20 | 20 2b 2b 2b 2b 2b 2b 2b |ions.   | +++++++|
|000026f0| 2b 2b 2b 2b 2b 2b 2b 0a | 0a 20 20 20 20 20 20 41 |+++++++.|.      A|
|00002700| 6e 20 65 73 70 65 63 69 | 61 6c 6c 79 20 76 61 6c |n especi|ally val|
|00002710| 75 61 62 6c 65 20 70 6f | 73 73 69 62 69 6c 69 74 |uable po|ssibilit|
|00002720| 79 20 6f 66 20 55 73 65 | 6e 65 74 20 69 73 20 6f |y of Use|net is o|
|00002730| 66 20 63 6f 75 72 73 65 | 0a 20 20 20 20 20 20 74 |f course|.      t|
|00002740| 68 61 74 20 6f 66 20 64 | 69 73 63 75 73 73 69 6e |hat of d|iscussin|
|00002750| 67 20 61 20 63 65 72 74 | 61 69 6e 20 74 6f 70 69 |g a cert|ain topi|
|00002760| 63 20 77 69 74 68 20 68 | 75 6e 64 72 65 64 73 20 |c with h|undreds |
|00002770| 6f 66 20 70 6f 74 65 6e | 74 69 61 6c 0a 20 20 20 |of poten|tial.   |
|00002780| 20 20 20 70 61 72 74 69 | 63 69 70 61 6e 74 73 2e |   parti|cipants.|
|00002790| 20 41 6c 6c 20 74 72 61 | 66 66 69 63 20 69 6e 20 | All tra|ffic in |
|000027a0| 74 68 65 20 6e 65 77 73 | 67 72 6f 75 70 20 74 68 |the news|group th|
|000027b0| 61 74 20 63 61 6e 20 6e | 6f 74 20 62 65 0a 20 20 |at can n|ot be.  |
|000027c0| 20 20 20 20 73 75 62 73 | 75 6d 65 64 20 75 6e 64 |    subs|umed und|
|000027d0| 65 72 20 6f 6e 65 20 6f | 66 20 74 68 65 20 61 62 |er one o|f the ab|
|000027e0| 6f 76 65 20 63 61 74 65 | 67 6f 72 69 65 73 20 73 |ove cate|gories s|
|000027f0| 68 6f 75 6c 64 20 62 65 | 6c 6f 6e 67 0a 20 20 20 |hould be|long.   |
|00002800| 20 20 20 74 6f 20 61 20 | 64 69 73 63 75 73 73 69 |   to a |discussi|
|00002810| 6f 6e 2e 0a 0a 20 20 20 | 20 20 20 49 66 20 73 6f |on...   |   If so|
|00002820| 6d 65 62 6f 64 79 20 65 | 78 70 6c 69 63 69 74 6c |mebody e|xplicitl|
|00002830| 79 20 77 61 6e 74 73 20 | 74 6f 20 73 74 61 72 74 |y wants |to start|
|00002840| 20 61 20 64 69 73 63 75 | 73 73 69 6f 6e 2c 20 68 | a discu|ssion, h|
|00002850| 65 2f 73 68 65 0a 20 20 | 20 20 20 20 63 61 6e 20 |e/she.  |    can |
|00002860| 64 6f 20 73 6f 20 62 79 | 20 67 69 76 69 6e 67 20 |do so by| giving |
|00002870| 74 68 65 20 70 6f 73 74 | 69 6e 67 20 61 20 73 75 |the post|ing a su|
|00002880| 62 6a 65 63 74 20 6c 69 | 6e 65 20 6f 66 20 74 68 |bject li|ne of th|
|00002890| 65 20 66 6f 72 6d 20 0a | 20 20 20 20 20 20 22 53 |e form .|      "S|
|000028a0| 75 62 6a 65 63 74 3a 20 | 44 69 73 63 75 73 73 69 |ubject: |Discussi|
|000028b0| 6f 6e 3a 20 74 68 69 73 | 2d 61 6e 64 2d 74 68 61 |on: this|-and-tha|
|000028c0| 74 22 0a 0a 20 20 20 20 | 20 20 49 74 20 69 73 20 |t"..    |  It is |
|000028d0| 71 75 69 74 65 20 64 69 | 66 66 69 63 75 6c 74 20 |quite di|fficult |
|000028e0| 74 6f 20 6b 65 65 70 20 | 61 20 64 69 73 63 75 73 |to keep |a discus|
|000028f0| 73 69 6f 6e 20 66 72 6f | 6d 20 64 72 69 66 74 69 |sion fro|m drifti|
|00002900| 6e 67 20 69 6e 74 6f 0a | 20 20 20 20 20 20 63 68 |ng into.|      ch|
|00002910| 61 6f 73 2c 20 62 75 74 | 2c 20 75 6e 66 6f 72 74 |aos, but|, unfort|
|00002920| 75 6e 61 74 65 6c 79 2c | 20 61 73 20 6d 61 6e 79 |unately,| as many|
|00002930| 20 6d 61 6e 79 20 6f 74 | 68 65 72 20 6e 65 77 73 | many ot|her news|
|00002940| 67 72 6f 75 70 73 0a 20 | 20 20 20 20 20 73 68 6f |groups. |     sho|
|00002950| 77 20 74 68 65 72 65 20 | 73 65 65 6d 73 20 74 6f |w there |seems to|
|00002960| 20 62 65 20 6e 6f 20 73 | 65 63 75 72 65 20 77 61 | be no s|ecure wa|
|00002970| 79 20 74 6f 20 61 76 6f | 69 64 20 74 68 69 73 2e |y to avo|id this.|
|00002980| 20 4f 6e 20 74 68 65 0a | 20 20 20 20 20 20 6f 74 | On the.|      ot|
|00002990| 68 65 72 20 68 61 6e 64 | 2c 20 63 6f 6d 70 2e 61 |her hand|, comp.a|
|000029a0| 69 2e 6e 65 75 72 61 6c | 2d 6e 65 74 73 20 68 61 |i.neural|-nets ha|
|000029b0| 73 20 6e 6f 74 20 68 61 | 64 20 6d 61 6e 79 0a 20 |s not ha|d many. |
|000029c0| 20 20 20 20 20 70 72 6f | 62 6c 65 6d 73 20 77 69 |     pro|blems wi|
|000029d0| 74 68 20 74 68 69 73 20 | 65 66 66 65 63 74 20 69 |th this |effect i|
|000029e0| 6e 20 74 68 65 20 70 61 | 73 74 2c 20 73 6f 20 6c |n the pa|st, so l|
|000029f0| 65 74 27 73 20 6a 75 73 | 74 20 67 6f 20 61 6e 64 |et's jus|t go and|
|00002a00| 0a 20 20 20 20 20 20 68 | 6f 70 65 2e 2e 2e 20 0a |.      h|ope... .|
|00002a10| 0a 20 20 20 2d 2d 2d 2d | 2d 2d 2d 2d 2d 2d 2d 2d |.   ----|--------|
|00002a20| 2d 2d 2d 2d 2d 2d 2d 2d | 2d 2d 2d 2d 2d 2d 2d 2d |--------|--------|
|00002a30| 2d 2d 2d 2d 2d 2d 2d 2d | 2d 2d 2d 2d 2d 2d 2d 2d |--------|--------|
|00002a40| 2d 2d 2d 2d 2d 2d 2d 2d | 2d 2d 2d 2d 2d 2d 2d 2d |--------|--------|
|00002a50| 2d 2d 2d 2d 2d 2d 2d 2d | 2d 2d 2d 2d 0a 0a 20 32 |--------|----.. 2|
|00002a60| 2e 20 41 3a 20 57 68 61 | 74 20 69 73 20 61 20 6e |. A: Wha|t is a n|
|00002a70| 65 75 72 61 6c 20 6e 65 | 74 77 6f 72 6b 20 28 4e |eural ne|twork (N|
|00002a80| 4e 29 3f 0a 20 3d 3d 3d | 3d 3d 3d 3d 3d 3d 3d 3d |N)?. ===|========|
|00002a90| 3d 3d 3d 3d 3d 3d 3d 3d | 3d 3d 3d 3d 3d 3d 3d 3d |========|========|
|00002aa0| 3d 3d 3d 3d 3d 3d 3d 3d | 3d 0a 0a 20 20 20 46 69 |========|=..   Fi|
|00002ab0| 72 73 74 20 6f 66 20 61 | 6c 6c 2c 20 77 68 65 6e |rst of a|ll, when|
|00002ac0| 20 77 65 20 61 72 65 20 | 74 61 6c 6b 69 6e 67 20 | we are |talking |
|00002ad0| 61 62 6f 75 74 20 61 20 | 6e 65 75 72 61 6c 20 6e |about a |neural n|
|00002ae0| 65 74 77 6f 72 6b 2c 20 | 77 65 0a 20 20 20 2a 73 |etwork, |we.   *s|
|00002af0| 68 6f 75 6c 64 2a 20 75 | 73 75 61 6c 6c 79 20 62 |hould* u|sually b|
|00002b00| 65 74 74 65 72 20 73 61 | 79 20 22 61 72 74 69 66 |etter sa|y "artif|
|00002b10| 69 63 69 61 6c 20 6e 65 | 75 72 61 6c 20 6e 65 74 |icial ne|ural net|
|00002b20| 77 6f 72 6b 22 20 28 41 | 4e 4e 29 2c 0a 20 20 20 |work" (A|NN),.   |
|00002b30| 62 65 63 61 75 73 65 20 | 74 68 61 74 20 69 73 20 |because |that is |
|00002b40| 77 68 61 74 20 77 65 20 | 6d 65 61 6e 20 6d 6f 73 |what we |mean mos|
|00002b50| 74 20 6f 66 20 74 68 65 | 20 74 69 6d 65 2e 20 42 |t of the| time. B|
|00002b60| 69 6f 6c 6f 67 69 63 61 | 6c 20 6e 65 75 72 61 6c |iologica|l neural|
|00002b70| 0a 20 20 20 6e 65 74 77 | 6f 72 6b 73 20 61 72 65 |.   netw|orks are|
|00002b80| 20 6d 75 63 68 20 6d 6f | 72 65 20 63 6f 6d 70 6c | much mo|re compl|
|00002b90| 69 63 61 74 65 64 20 69 | 6e 20 74 68 65 69 72 20 |icated i|n their |
|00002ba0| 65 6c 65 6d 65 6e 74 61 | 72 79 0a 20 20 20 73 74 |elementa|ry.   st|
|00002bb0| 72 75 63 74 75 72 65 73 | 20 74 68 61 6e 20 74 68 |ructures| than th|
|00002bc0| 65 20 6d 61 74 68 65 6d | 61 74 69 63 61 6c 20 6d |e mathem|atical m|
|00002bd0| 6f 64 65 6c 73 20 77 65 | 20 75 73 65 20 66 6f 72 |odels we| use for|
|00002be0| 20 41 4e 4e 73 2e 0a 0a | 20 20 20 41 20 76 61 67 | ANNs...|   A vag|
|00002bf0| 75 65 20 64 65 73 63 72 | 69 70 74 69 6f 6e 20 69 |ue descr|iption i|
|00002c00| 73 20 61 73 20 66 6f 6c | 6c 6f 77 73 3a 0a 0a 20 |s as fol|lows:.. |
|00002c10| 20 20 41 6e 20 41 4e 4e | 20 69 73 20 61 20 6e 65 |  An ANN| is a ne|
|00002c20| 74 77 6f 72 6b 20 6f 66 | 20 6d 61 6e 79 20 76 65 |twork of| many ve|
|00002c30| 72 79 20 73 69 6d 70 6c | 65 20 70 72 6f 63 65 73 |ry simpl|e proces|
|00002c40| 73 6f 72 73 20 28 22 75 | 6e 69 74 73 22 29 2c 0a |sors ("u|nits"),.|
|00002c50| 20 20 20 65 61 63 68 20 | 70 6f 73 73 69 62 6c 79 |   each |possibly|
|00002c60| 20 68 61 76 69 6e 67 20 | 61 20 28 73 6d 61 6c 6c | having |a (small|
|00002c70| 20 61 6d 6f 75 6e 74 20 | 6f 66 29 20 6c 6f 63 61 | amount |of) loca|
|00002c80| 6c 20 6d 65 6d 6f 72 79 | 2e 20 54 68 65 20 75 6e |l memory|. The un|
|00002c90| 69 74 73 0a 20 20 20 61 | 72 65 20 63 6f 6e 6e 65 |its.   a|re conne|
|00002ca0| 63 74 65 64 20 62 79 20 | 75 6e 69 64 69 72 65 63 |cted by |unidirec|
|00002cb0| 74 69 6f 6e 61 6c 20 63 | 6f 6d 6d 75 6e 69 63 61 |tional c|ommunica|
|00002cc0| 74 69 6f 6e 20 63 68 61 | 6e 6e 65 6c 73 0a 20 20 |tion cha|nnels.  |
|00002cd0| 20 28 22 63 6f 6e 6e 65 | 63 74 69 6f 6e 73 22 29 | ("conne|ctions")|
|00002ce0| 2c 20 77 68 69 63 68 20 | 63 61 72 72 79 20 6e 75 |, which |carry nu|
|00002cf0| 6d 65 72 69 63 20 28 61 | 73 20 6f 70 70 6f 73 65 |meric (a|s oppose|
|00002d00| 64 20 74 6f 20 73 79 6d | 62 6f 6c 69 63 29 0a 20 |d to sym|bolic). |
|00002d10| 20 20 64 61 74 61 2e 20 | 54 68 65 20 75 6e 69 74 |  data. |The unit|
|00002d20| 73 20 6f 70 65 72 61 74 | 65 20 6f 6e 6c 79 20 6f |s operat|e only o|
|00002d30| 6e 20 74 68 65 69 72 20 | 6c 6f 63 61 6c 20 64 61 |n their |local da|
|00002d40| 74 61 20 61 6e 64 20 6f | 6e 20 74 68 65 20 69 6e |ta and o|n the in|
|00002d50| 70 75 74 73 0a 20 20 20 | 74 68 65 79 20 72 65 63 |puts.   |they rec|
|00002d60| 65 69 76 65 20 76 69 61 | 20 74 68 65 20 63 6f 6e |eive via| the con|
|00002d70| 6e 65 63 74 69 6f 6e 73 | 2e 0a 0a 20 20 20 54 68 |nections|...   Th|
|00002d80| 65 20 64 65 73 69 67 6e | 20 6d 6f 74 69 76 61 74 |e design| motivat|
|00002d90| 69 6f 6e 20 69 73 20 77 | 68 61 74 20 64 69 73 74 |ion is w|hat dist|
|00002da0| 69 6e 67 75 69 73 68 65 | 73 20 6e 65 75 72 61 6c |inguishe|s neural|
|00002db0| 20 6e 65 74 77 6f 72 6b | 73 20 66 72 6f 6d 0a 20 | network|s from. |
|00002dc0| 20 20 6f 74 68 65 72 20 | 6d 61 74 68 65 6d 61 74 |  other |mathemat|
|00002dd0| 69 63 61 6c 20 74 65 63 | 68 6e 69 71 75 65 73 3a |ical tec|hniques:|
|00002de0| 0a 0a 20 20 20 41 20 6e | 65 75 72 61 6c 20 6e 65 |..   A n|eural ne|
|00002df0| 74 77 6f 72 6b 20 69 73 | 20 61 20 70 72 6f 63 65 |twork is| a proce|
|00002e00| 73 73 69 6e 67 20 64 65 | 76 69 63 65 2c 20 65 69 |ssing de|vice, ei|
|00002e10| 74 68 65 72 20 61 6e 20 | 61 6c 67 6f 72 69 74 68 |ther an |algorith|
|00002e20| 6d 2c 20 6f 72 0a 20 20 | 20 61 63 74 75 61 6c 20 |m, or.  | actual |
|00002e30| 68 61 72 64 77 61 72 65 | 2c 20 77 68 6f 73 65 20 |hardware|, whose |
|00002e40| 64 65 73 69 67 6e 20 77 | 61 73 20 6d 6f 74 69 76 |design w|as motiv|
|00002e50| 61 74 65 64 20 62 79 20 | 74 68 65 20 64 65 73 69 |ated by |the desi|
|00002e60| 67 6e 20 61 6e 64 0a 20 | 20 20 66 75 6e 63 74 69 |gn and. |  functi|
|00002e70| 6f 6e 69 6e 67 20 6f 66 | 20 68 75 6d 61 6e 20 62 |oning of| human b|
|00002e80| 72 61 69 6e 73 20 61 6e | 64 20 63 6f 6d 70 6f 6e |rains an|d compon|
|00002e90| 65 6e 74 73 20 74 68 65 | 72 65 6f 66 2e 0a 0a 20 |ents the|reof... |
|00002ea0| 20 20 4d 6f 73 74 20 6e | 65 75 72 61 6c 20 6e 65 |  Most n|eural ne|
|00002eb0| 74 77 6f 72 6b 73 20 68 | 61 76 65 20 73 6f 6d 65 |tworks h|ave some|
|00002ec0| 20 73 6f 72 74 20 6f 66 | 20 22 74 72 61 69 6e 69 | sort of| "traini|
|00002ed0| 6e 67 22 20 72 75 6c 65 | 20 77 68 65 72 65 62 79 |ng" rule| whereby|
|00002ee0| 0a 20 20 20 74 68 65 20 | 77 65 69 67 68 74 73 20 |.   the |weights |
|00002ef0| 6f 66 20 63 6f 6e 6e 65 | 63 74 69 6f 6e 73 20 61 |of conne|ctions a|
|00002f00| 72 65 20 61 64 6a 75 73 | 74 65 64 20 6f 6e 20 74 |re adjus|ted on t|
|00002f10| 68 65 20 62 61 73 69 73 | 20 6f 66 20 70 72 65 73 |he basis| of pres|
|00002f20| 65 6e 74 65 64 0a 20 20 | 20 70 61 74 74 65 72 6e |ented.  | pattern|
|00002f30| 73 2e 20 49 6e 20 6f 74 | 68 65 72 20 77 6f 72 64 |s. In ot|her word|
|00002f40| 73 2c 20 6e 65 75 72 61 | 6c 20 6e 65 74 77 6f 72 |s, neura|l networ|
|00002f50| 6b 73 20 22 6c 65 61 72 | 6e 22 20 66 72 6f 6d 20 |ks "lear|n" from |
|00002f60| 65 78 61 6d 70 6c 65 73 | 2c 0a 20 20 20 6a 75 73 |examples|,.   jus|
|00002f70| 74 20 6c 69 6b 65 20 63 | 68 69 6c 64 72 65 6e 20 |t like c|hildren |
|00002f80| 6c 65 61 72 6e 20 74 6f | 20 72 65 63 6f 67 6e 69 |learn to| recogni|
|00002f90| 7a 65 20 64 6f 67 73 20 | 66 72 6f 6d 20 65 78 61 |ze dogs |from exa|
|00002fa0| 6d 70 6c 65 73 20 6f 66 | 20 64 6f 67 73 2c 0a 20 |mples of| dogs,. |
|00002fb0| 20 20 61 6e 64 20 65 78 | 68 69 62 69 74 20 73 6f |  and ex|hibit so|
|00002fc0| 6d 65 20 73 74 72 75 63 | 74 75 72 61 6c 20 63 61 |me struc|tural ca|
|00002fd0| 70 61 62 69 6c 69 74 79 | 20 66 6f 72 20 67 65 6e |pability| for gen|
|00002fe0| 65 72 61 6c 69 7a 61 74 | 69 6f 6e 2e 0a 0a 20 20 |eralizat|ion...  |
|00002ff0| 20 4e 65 75 72 61 6c 20 | 6e 65 74 77 6f 72 6b 73 | Neural |networks|
|00003000| 20 6e 6f 72 6d 61 6c 6c | 79 20 68 61 76 65 20 67 | normall|y have g|
|00003010| 72 65 61 74 20 70 6f 74 | 65 6e 74 69 61 6c 20 66 |reat pot|ential f|
|00003020| 6f 72 20 70 61 72 61 6c | 6c 65 6c 69 73 6d 2c 0a |or paral|lelism,.|
|00003030| 20 20 20 73 69 6e 63 65 | 20 74 68 65 20 63 6f 6d |   since| the com|
|00003040| 70 75 74 61 74 69 6f 6e | 73 20 6f 66 20 74 68 65 |putation|s of the|
|00003050| 20 63 6f 6d 70 6f 6e 65 | 6e 74 73 20 61 72 65 20 | compone|nts are |
|00003060| 69 6e 64 65 70 65 6e 64 | 65 6e 74 20 6f 66 20 65 |independ|ent of e|
|00003070| 61 63 68 0a 20 20 20 6f | 74 68 65 72 2e 20 0a 0a |ach.   o|ther. ..|
|00003080| 20 20 20 2d 2d 2d 2d 2d | 2d 2d 2d 2d 2d 2d 2d 2d |   -----|--------|
|00003090| 2d 2d 2d 2d 2d 2d 2d 2d | 2d 2d 2d 2d 2d 2d 2d 2d |--------|--------|
|000030a0| 2d 2d 2d 2d 2d 2d 2d 2d | 2d 2d 2d 2d 2d 2d 2d 2d |--------|--------|
|000030b0| 2d 2d 2d 2d 2d 2d 2d 2d | 2d 2d 2d 2d 2d 2d 2d 2d |--------|--------|
|000030c0| 2d 2d 2d 2d 2d 2d 2d 2d | 2d 2d 2d 0a 0a 20 33 2e |--------|---.. 3.|
|000030d0| 20 41 3a 20 57 68 61 74 | 20 63 61 6e 20 79 6f 75 | A: What| can you|
|000030e0| 20 64 6f 20 77 69 74 68 | 20 61 20 4e 65 75 72 61 | do with| a Neura|
|000030f0| 6c 20 4e 65 74 77 6f 72 | 6b 20 61 6e 64 0a 20 3d |l Networ|k and. =|
|00003100| 3d 3d 3d 3d 3d 3d 3d 3d | 3d 3d 3d 3d 3d 3d 3d 3d |========|========|
|00003110| 3d 3d 3d 3d 3d 3d 3d 3d | 3d 3d 3d 3d 3d 3d 3d 3d |========|========|
|00003120| 3d 3d 3d 3d 3d 3d 3d 3d | 3d 3d 3d 3d 3d 3d 0a 20 |========|======. |
|00003130| 20 20 77 68 61 74 20 6e | 6f 74 3f 0a 20 20 20 3d |  what n|ot?.   =|
|00003140| 3d 3d 3d 3d 3d 3d 3d 3d | 0a 0a 20 20 20 49 6e 20 |========|..   In |
|00003150| 70 72 69 6e 63 69 70 6c | 65 2c 20 4e 4e 73 20 63 |principl|e, NNs c|
|00003160| 61 6e 20 63 6f 6d 70 75 | 74 65 20 61 6e 79 20 63 |an compu|te any c|
|00003170| 6f 6d 70 75 74 61 62 6c | 65 20 66 75 6e 63 74 69 |omputabl|e functi|
|00003180| 6f 6e 2c 20 69 2e 65 2e | 20 74 68 65 79 0a 20 20 |on, i.e.| they.  |
|00003190| 20 63 61 6e 20 64 6f 20 | 65 76 65 72 79 74 68 69 | can do |everythi|
|000031a0| 6e 67 20 61 20 6e 6f 72 | 6d 61 6c 20 64 69 67 69 |ng a nor|mal digi|
|000031b0| 74 61 6c 20 63 6f 6d 70 | 75 74 65 72 20 63 61 6e |tal comp|uter can|
|000031c0| 20 64 6f 2e 20 45 73 70 | 65 63 69 61 6c 6c 79 0a | do. Esp|ecially.|
|000031d0| 20 20 20 61 6e 79 74 68 | 69 6e 67 20 74 68 61 74 |   anyth|ing that|
|000031e0| 20 63 61 6e 20 62 65 20 | 72 65 70 72 65 73 65 6e | can be |represen|
|000031f0| 74 65 64 20 61 73 20 61 | 20 6d 61 70 70 69 6e 67 |ted as a| mapping|
|00003200| 20 62 65 74 77 65 65 6e | 20 76 65 63 74 6f 72 0a | between| vector.|
|00003210| 20 20 20 73 70 61 63 65 | 73 20 63 61 6e 20 62 65 |   space|s can be|
|00003220| 20 61 70 70 72 6f 78 69 | 6d 61 74 65 64 20 74 6f | approxi|mated to|
|00003230| 20 61 72 62 69 74 72 61 | 72 79 20 70 72 65 63 69 | arbitra|ry preci|
|00003240| 73 69 6f 6e 20 62 79 20 | 66 65 65 64 66 6f 72 77 |sion by |feedforw|
|00003250| 61 72 64 0a 20 20 20 4e | 4e 73 20 28 77 68 69 63 |ard.   N|Ns (whic|
|00003260| 68 20 69 73 20 74 68 65 | 20 6d 6f 73 74 20 6f 66 |h is the| most of|
|00003270| 74 65 6e 20 75 73 65 64 | 20 74 79 70 65 29 2e 0a |ten used| type)..|
|00003280| 0a 20 20 20 49 6e 20 70 | 72 61 63 74 69 63 65 2c |.   In p|ractice,|
|00003290| 20 4e 4e 73 20 61 72 65 | 20 65 73 70 65 63 69 61 | NNs are| especia|
|000032a0| 6c 6c 79 20 75 73 65 66 | 75 6c 20 66 6f 72 20 6d |lly usef|ul for m|
|000032b0| 61 70 70 69 6e 67 20 70 | 72 6f 62 6c 65 6d 73 20 |apping p|roblems |
|000032c0| 77 68 69 63 68 0a 20 20 | 20 61 72 65 20 74 6f 6c |which.  | are tol|
|000032d0| 65 72 61 6e 74 20 6f 66 | 20 73 6f 6d 65 20 65 72 |erant of| some er|
|000032e0| 72 6f 72 73 2c 20 68 61 | 76 65 20 6c 6f 74 73 20 |rors, ha|ve lots |
|000032f0| 6f 66 20 65 78 61 6d 70 | 6c 65 20 64 61 74 61 20 |of examp|le data |
|00003300| 61 76 61 69 6c 61 62 6c | 65 2c 0a 20 20 20 62 75 |availabl|e,.   bu|
|00003310| 74 20 74 6f 20 77 68 69 | 63 68 20 68 61 72 64 20 |t to whi|ch hard |
|00003320| 61 6e 64 20 66 61 73 74 | 20 72 75 6c 65 73 20 63 |and fast| rules c|
|00003330| 61 6e 20 6e 6f 74 20 65 | 61 73 69 6c 79 20 62 65 |an not e|asily be|
|00003340| 20 61 70 70 6c 69 65 64 | 2e 20 4e 4e 73 0a 20 20 | applied|. NNs.  |
|00003350| 20 61 72 65 2c 20 61 74 | 20 6c 65 61 73 74 20 74 | are, at| least t|
|00003360| 6f 64 61 79 2c 20 64 69 | 66 66 69 63 75 6c 74 20 |oday, di|fficult |
|00003370| 74 6f 20 61 70 70 6c 79 | 20 73 75 63 63 65 73 73 |to apply| success|
|00003380| 66 75 6c 6c 79 20 74 6f | 20 70 72 6f 62 6c 65 6d |fully to| problem|
|00003390| 73 20 74 68 61 74 0a 20 | 20 20 63 6f 6e 63 65 72 |s that. |  concer|
|000033a0| 6e 20 6d 61 6e 69 70 75 | 6c 61 74 69 6f 6e 20 6f |n manipu|lation o|
|000033b0| 66 20 73 79 6d 62 6f 6c | 73 20 61 6e 64 20 6d 65 |f symbol|s and me|
|000033c0| 6d 6f 72 79 2e 20 0a 0a | 20 20 20 2d 2d 2d 2d 2d |mory. ..|   -----|
|000033d0| 2d 2d 2d 2d 2d 2d 2d 2d | 2d 2d 2d 2d 2d 2d 2d 2d |--------|--------|
|000033e0| 2d 2d 2d 2d 2d 2d 2d 2d | 2d 2d 2d 2d 2d 2d 2d 2d |--------|--------|
|000033f0| 2d 2d 2d 2d 2d 2d 2d 2d | 2d 2d 2d 2d 2d 2d 2d 2d |--------|--------|
|00003400| 2d 2d 2d 2d 2d 2d 2d 2d | 2d 2d 2d 2d 2d 2d 2d 2d |--------|--------|
|00003410| 2d 2d 2d 0a 0a 20 34 2e | 20 41 3a 20 57 68 6f 20 |---.. 4.| A: Who |
|00003420| 69 73 20 63 6f 6e 63 65 | 72 6e 65 64 20 77 69 74 |is conce|rned wit|
|00003430| 68 20 4e 65 75 72 61 6c | 20 4e 65 74 77 6f 72 6b |h Neural| Network|
|00003440| 73 3f 0a 20 3d 3d 3d 3d | 3d 3d 3d 3d 3d 3d 3d 3d |s?. ====|========|
|00003450| 3d 3d 3d 3d 3d 3d 3d 3d | 3d 3d 3d 3d 3d 3d 3d 3d |========|========|
|00003460| 3d 3d 3d 3d 3d 3d 3d 3d | 3d 3d 3d 3d 3d 3d 3d 3d |========|========|
|00003470| 0a 0a 20 20 20 4e 65 75 | 72 61 6c 20 4e 65 74 77 |..   Neu|ral Netw|
|00003480| 6f 72 6b 73 20 61 72 65 | 20 69 6e 74 65 72 65 73 |orks are| interes|
|00003490| 74 69 6e 67 20 66 6f 72 | 20 71 75 69 74 65 20 61 |ting for| quite a|
|000034a0| 20 6c 6f 74 20 6f 66 20 | 76 65 72 79 20 64 69 73 | lot of |very dis|
|000034b0| 73 69 6d 69 6c 61 72 0a | 20 20 20 70 65 6f 70 6c |similar.|   peopl|
|000034c0| 65 3a 20 0a 20 20 20 20 | 6f 20 43 6f 6d 70 75 74 |e: .    |o Comput|
|000034d0| 65 72 20 73 63 69 65 6e | 74 69 73 74 73 20 77 61 |er scien|tists wa|
|000034e0| 6e 74 20 74 6f 20 66 69 | 6e 64 20 6f 75 74 20 61 |nt to fi|nd out a|
|000034f0| 62 6f 75 74 20 74 68 65 | 20 70 72 6f 70 65 72 74 |bout the| propert|
|00003500| 69 65 73 0a 20 20 20 20 | 20 20 6f 66 20 6e 6f 6e |ies.    |  of non|
|00003510| 2d 73 79 6d 62 6f 6c 69 | 63 20 69 6e 66 6f 72 6d |-symboli|c inform|
|00003520| 61 74 69 6f 6e 20 70 72 | 6f 63 65 73 73 69 6e 67 |ation pr|ocessing|
|00003530| 20 77 69 74 68 20 6e 65 | 75 72 61 6c 20 6e 65 74 | with ne|ural net|
|00003540| 73 0a 20 20 20 20 20 20 | 61 6e 64 20 61 62 6f 75 |s.      |and abou|
|00003550| 74 20 6c 65 61 72 6e 69 | 6e 67 20 73 79 73 74 65 |t learni|ng syste|
|00003560| 6d 73 20 69 6e 20 67 65 | 6e 65 72 61 6c 2e 20 0a |ms in ge|neral. .|
|00003570| 20 20 20 20 6f 20 45 6e | 67 69 6e 65 65 72 73 20 |    o En|gineers |
|00003580| 6f 66 20 6d 61 6e 79 20 | 6b 69 6e 64 73 20 77 61 |of many |kinds wa|
|00003590| 6e 74 20 74 6f 20 65 78 | 70 6c 6f 69 74 20 74 68 |nt to ex|ploit th|
|000035a0| 65 20 63 61 70 61 62 69 | 6c 69 74 69 65 73 20 6f |e capabi|lities o|
|000035b0| 66 0a 20 20 20 20 20 20 | 6e 65 75 72 61 6c 20 6e |f.      |neural n|
|000035c0| 65 74 77 6f 72 6b 73 20 | 6f 6e 20 6d 61 6e 79 20 |etworks |on many |
|000035d0| 61 72 65 61 73 20 28 65 | 2e 67 2e 20 73 69 67 6e |areas (e|.g. sign|
|000035e0| 61 6c 20 70 72 6f 63 65 | 73 73 69 6e 67 29 20 74 |al proce|ssing) t|
|000035f0| 6f 0a 20 20 20 20 20 20 | 73 6f 6c 76 65 20 74 68 |o.      |solve th|
|00003600| 65 69 72 20 61 70 70 6c | 69 63 61 74 69 6f 6e 20 |eir appl|ication |
|00003610| 70 72 6f 62 6c 65 6d 73 | 2e 20 0a 20 20 20 20 6f |problems|. .    o|
|00003620| 20 43 6f 67 6e 69 74 69 | 76 65 20 73 63 69 65 6e | Cogniti|ve scien|
|00003630| 74 69 73 74 73 20 76 69 | 65 77 20 6e 65 75 72 61 |tists vi|ew neura|
|00003640| 6c 20 6e 65 74 77 6f 72 | 6b 73 20 61 73 20 61 20 |l networ|ks as a |
|00003650| 70 6f 73 73 69 62 6c 65 | 0a 20 20 20 20 20 20 61 |possible|.      a|
|00003660| 70 70 61 72 61 74 75 73 | 20 74 6f 20 64 65 73 63 |pparatus| to desc|
|00003670| 72 69 62 65 20 6d 6f 64 | 65 6c 73 20 6f 66 20 74 |ribe mod|els of t|
|00003680| 68 69 6e 6b 69 6e 67 20 | 61 6e 64 20 63 6f 6e 73 |hinking |and cons|
|00003690| 63 69 65 6e 63 65 0a 20 | 20 20 20 20 20 28 48 69 |cience. |     (Hi|
|000036a0| 67 68 2d 6c 65 76 65 6c | 20 62 72 61 69 6e 20 66 |gh-level| brain f|
|000036b0| 75 6e 63 74 69 6f 6e 29 | 2e 20 0a 20 20 20 20 6f |unction)|. .    o|
|000036c0| 20 4e 65 75 72 6f 2d 70 | 68 79 73 69 6f 6c 6f 67 | Neuro-p|hysiolog|
|000036d0| 69 73 74 73 20 75 73 65 | 20 6e 65 75 72 61 6c 20 |ists use| neural |
|000036e0| 6e 65 74 77 6f 72 6b 73 | 20 74 6f 20 64 65 73 63 |networks| to desc|
|000036f0| 72 69 62 65 20 61 6e 64 | 0a 20 20 20 20 20 20 65 |ribe and|.      e|
|00003700| 78 70 6c 6f 72 65 20 6d | 65 64 69 75 6d 2d 6c 65 |xplore m|edium-le|
|00003710| 76 65 6c 20 62 72 61 69 | 6e 20 66 75 6e 63 74 69 |vel brai|n functi|
|00003720| 6f 6e 20 28 65 2e 67 2e | 20 6d 65 6d 6f 72 79 2c |on (e.g.| memory,|
|00003730| 20 73 65 6e 73 6f 72 79 | 0a 20 20 20 20 20 20 73 | sensory|.      s|
|00003740| 79 73 74 65 6d 2c 20 6d | 6f 74 6f 72 69 63 73 29 |ystem, m|otorics)|
|00003750| 2e 20 0a 20 20 20 20 6f | 20 50 68 79 73 69 63 69 |. .    o| Physici|
|00003760| 73 74 73 20 75 73 65 20 | 6e 65 75 72 61 6c 20 6e |sts use |neural n|
|00003770| 65 74 77 6f 72 6b 73 20 | 74 6f 20 6d 6f 64 65 6c |etworks |to model|
|00003780| 20 70 68 65 6e 6f 6d 65 | 6e 61 20 69 6e 0a 20 20 | phenome|na in.  |
|00003790| 20 20 20 20 73 74 61 74 | 69 73 74 69 63 61 6c 20 |    stat|istical |
|000037a0| 6d 65 63 68 61 6e 69 63 | 73 20 61 6e 64 20 66 6f |mechanic|s and fo|
|000037b0| 72 20 61 20 6c 6f 74 20 | 6f 66 20 6f 74 68 65 72 |r a lot |of other|
|000037c0| 20 74 61 73 6b 73 2e 20 | 0a 20 20 20 20 6f 20 42 | tasks. |.    o B|
|000037d0| 69 6f 6c 6f 67 69 73 74 | 73 20 75 73 65 20 4e 65 |iologist|s use Ne|
|000037e0| 75 72 61 6c 20 4e 65 74 | 77 6f 72 6b 73 20 74 6f |ural Net|works to|
|000037f0| 20 69 6e 74 65 72 70 72 | 65 74 20 6e 75 63 6c 65 | interpr|et nucle|
|00003800| 6f 74 69 64 65 0a 20 20 | 20 20 20 20 73 65 71 75 |otide.  |    sequ|
|00003810| 65 6e 63 65 73 2e 20 0a | 20 20 20 20 6f 20 50 68 |ences. .|    o Ph|
|00003820| 69 6c 6f 73 6f 70 68 65 | 72 73 20 61 6e 64 20 73 |ilosophe|rs and s|
|00003830| 6f 6d 65 20 6f 74 68 65 | 72 20 70 65 6f 70 6c 65 |ome othe|r people|
|00003840| 20 6d 61 79 20 61 6c 73 | 6f 20 62 65 20 69 6e 74 | may als|o be int|
|00003850| 65 72 65 73 74 65 64 0a | 20 20 20 20 20 20 69 6e |erested.|      in|
|00003860| 20 4e 65 75 72 61 6c 20 | 4e 65 74 77 6f 72 6b 73 | Neural |Networks|
|00003870| 20 66 6f 72 20 76 61 72 | 69 6f 75 73 20 72 65 61 | for var|ious rea|
|00003880| 73 6f 6e 73 2e 20 0a 0a | 20 20 20 2d 2d 2d 2d 2d |sons. ..|   -----|
|00003890| 2d 2d 2d 2d 2d 2d 2d 2d | 2d 2d 2d 2d 2d 2d 2d 2d |--------|--------|
|000038a0| 2d 2d 2d 2d 2d 2d 2d 2d | 2d 2d 2d 2d 2d 2d 2d 2d |--------|--------|
|000038b0| 2d 2d 2d 2d 2d 2d 2d 2d | 2d 2d 2d 2d 2d 2d 2d 2d |--------|--------|
|000038c0| 2d 2d 2d 2d 2d 2d 2d 2d | 2d 2d 2d 2d 2d 2d 2d 2d |--------|--------|
|000038d0| 2d 2d 2d 0a 0a 20 35 2e | 20 41 3a 20 57 68 61 74 |---.. 5.| A: What|
|000038e0| 20 64 6f 65 73 20 27 62 | 61 63 6b 70 72 6f 70 27 | does 'b|ackprop'|
|000038f0| 20 6d 65 61 6e 3f 20 57 | 68 61 74 20 69 73 0a 20 | mean? W|hat is. |
|00003900| 3d 3d 3d 3d 3d 3d 3d 3d | 3d 3d 3d 3d 3d 3d 3d 3d |========|========|
|00003910| 3d 3d 3d 3d 3d 3d 3d 3d | 3d 3d 3d 3d 3d 3d 3d 3d |========|========|
|00003920| 3d 3d 3d 3d 3d 3d 3d 3d | 0a 20 20 20 27 6f 76 65 |========|.   'ove|
|00003930| 72 66 69 74 74 69 6e 67 | 27 3f 20 0a 20 20 20 3d |rfitting|'? .   =|
|00003940| 3d 3d 3d 3d 3d 3d 3d 3d | 3d 3d 3d 3d 3d 3d 0a 0a |========|======..|
|00003950| 20 20 20 27 42 61 63 6b | 70 72 6f 70 27 20 69 73 |   'Back|prop' is|
|00003960| 20 61 6e 20 61 62 62 72 | 65 76 69 61 74 69 6f 6e | an abbr|eviation|
|00003970| 20 66 6f 72 20 27 62 61 | 63 6b 70 72 6f 70 61 67 | for 'ba|ckpropag|
|00003980| 61 74 69 6f 6e 20 6f 66 | 20 65 72 72 6f 72 27 20 |ation of| error' |
|00003990| 77 68 69 63 68 0a 20 20 | 20 69 73 20 74 68 65 20 |which.  | is the |
|000039a0| 6d 6f 73 74 20 77 69 64 | 65 6c 79 20 75 73 65 64 |most wid|ely used|
|000039b0| 20 6c 65 61 72 6e 69 6e | 67 20 6d 65 74 68 6f 64 | learnin|g method|
|000039c0| 20 66 6f 72 20 6e 65 75 | 72 61 6c 20 6e 65 74 77 | for neu|ral netw|
|000039d0| 6f 72 6b 73 0a 20 20 20 | 74 6f 64 61 79 2e 20 41 |orks.   |today. A|
|000039e0| 6c 74 68 6f 75 67 68 20 | 69 74 20 68 61 73 20 6d |lthough |it has m|
|000039f0| 61 6e 79 20 64 69 73 61 | 64 76 61 6e 74 61 67 65 |any disa|dvantage|
|00003a00| 73 2c 20 77 68 69 63 68 | 20 63 6f 75 6c 64 20 62 |s, which| could b|
|00003a10| 65 0a 20 20 20 73 75 6d | 6d 61 72 69 7a 65 64 20 |e.   sum|marized |
|00003a20| 69 6e 20 74 68 65 20 73 | 65 6e 74 65 6e 63 65 20 |in the s|entence |
|00003a30| 22 59 6f 75 20 61 72 65 | 20 61 6c 6d 6f 73 74 20 |"You are| almost |
|00003a40| 6e 6f 74 20 6b 6e 6f 77 | 69 6e 67 20 77 68 61 74 |not know|ing what|
|00003a50| 0a 20 20 20 79 6f 75 20 | 61 72 65 20 61 63 74 75 |.   you |are actu|
|00003a60| 61 6c 6c 79 20 64 6f 69 | 6e 67 20 77 68 65 6e 20 |ally doi|ng when |
|00003a70| 75 73 69 6e 67 20 62 61 | 63 6b 70 72 6f 70 61 67 |using ba|ckpropag|
|00003a80| 61 74 69 6f 6e 22 20 3a | 2d 29 20 69 74 20 68 61 |ation" :|-) it ha|
|00003a90| 73 0a 20 20 20 70 72 65 | 74 74 79 20 6d 75 63 68 |s.   pre|tty much|
|00003aa0| 20 73 75 63 63 65 73 73 | 20 6f 6e 20 70 72 61 63 | success| on prac|
|00003ab0| 74 69 63 61 6c 20 61 70 | 70 6c 69 63 61 74 69 6f |tical ap|plicatio|
|00003ac0| 6e 73 20 61 6e 64 20 69 | 73 20 72 65 6c 61 74 69 |ns and i|s relati|
|00003ad0| 76 65 6c 79 20 65 61 73 | 79 0a 20 20 20 74 6f 20 |vely eas|y.   to |
|00003ae0| 61 70 70 6c 79 2e 0a 0a | 20 20 20 49 74 20 69 73 |apply...|   It is|
|00003af0| 20 66 6f 72 20 74 68 65 | 20 74 72 61 69 6e 69 6e | for the| trainin|
|00003b00| 67 20 6f 66 20 6c 61 79 | 65 72 65 64 20 28 69 2e |g of lay|ered (i.|
|00003b10| 65 2e 2c 20 6e 6f 64 65 | 73 20 61 72 65 20 67 72 |e., node|s are gr|
|00003b20| 6f 75 70 65 64 20 69 6e | 20 6c 61 79 65 72 73 29 |ouped in| layers)|
|00003b30| 0a 20 20 20 66 65 65 64 | 66 6f 72 77 61 72 64 20 |.   feed|forward |
|00003b40| 28 69 2e 65 2e 2c 20 74 | 68 65 20 61 72 63 73 20 |(i.e., t|he arcs |
|00003b50| 6a 6f 69 6e 69 6e 67 20 | 6e 6f 64 65 73 20 61 72 |joining |nodes ar|
|00003b60| 65 20 75 6e 69 64 69 72 | 65 63 74 69 6f 6e 61 6c |e unidir|ectional|
|00003b70| 2c 20 61 6e 64 0a 20 20 | 20 74 68 65 72 65 20 61 |, and.  | there a|
|00003b80| 72 65 20 6e 6f 20 63 79 | 63 6c 65 73 29 20 6e 65 |re no cy|cles) ne|
|00003b90| 74 73 20 28 6f 66 74 65 | 6e 20 63 61 6c 6c 65 64 |ts (ofte|n called|
|00003ba0| 20 22 6d 75 6c 74 69 20 | 6c 61 79 65 72 20 70 65 | "multi |layer pe|
|00003bb0| 72 63 65 70 74 72 6f 6e | 73 22 29 2e 0a 0a 20 20 |rceptron|s")...  |
|00003bc0| 20 42 61 63 6b 2d 70 72 | 6f 70 61 67 61 74 69 6f | Back-pr|opagatio|
|00003bd0| 6e 20 6e 65 65 64 73 20 | 61 20 74 65 61 63 68 65 |n needs |a teache|
|00003be0| 72 20 74 68 61 74 20 6b | 6e 6f 77 73 20 74 68 65 |r that k|nows the|
|00003bf0| 20 63 6f 72 72 65 63 74 | 20 6f 75 74 70 75 74 0a | correct| output.|
|00003c00| 20 20 20 66 6f 72 20 61 | 6e 79 20 69 6e 70 75 74 |   for a|ny input|
|00003c10| 20 28 22 73 75 70 65 72 | 76 69 73 65 64 20 6c 65 | ("super|vised le|
|00003c20| 61 72 6e 69 6e 67 22 29 | 20 61 6e 64 20 75 73 65 |arning")| and use|
|00003c30| 73 20 67 72 61 64 69 65 | 6e 74 20 64 65 73 63 65 |s gradie|nt desce|
|00003c40| 6e 74 20 6f 6e 0a 20 20 | 20 74 68 65 20 65 72 72 |nt on.  | the err|
|00003c50| 6f 72 20 28 61 73 20 70 | 72 6f 76 69 64 65 64 20 |or (as p|rovided |
|00003c60| 62 79 20 74 68 65 20 74 | 65 61 63 68 65 72 29 20 |by the t|eacher) |
|00003c70| 74 6f 20 74 72 61 69 6e | 20 74 68 65 20 77 65 69 |to train| the wei|
|00003c80| 67 68 74 73 2e 20 54 68 | 65 0a 20 20 20 61 63 74 |ghts. Th|e.   act|
|00003c90| 69 76 61 74 69 6f 6e 20 | 66 75 6e 63 74 69 6f 6e |ivation |function|
|00003ca0| 20 69 73 20 28 75 73 75 | 61 6c 6c 79 29 20 61 20 | is (usu|ally) a |
|00003cb0| 73 69 67 6d 6f 69 64 61 | 6c 20 28 69 2e 65 2e 2c |sigmoida|l (i.e.,|
|00003cc0| 20 62 6f 75 6e 64 65 64 | 20 61 62 6f 76 65 0a 20 | bounded| above. |
|00003cd0| 20 20 61 6e 64 20 62 65 | 6c 6f 77 2c 20 62 75 74 |  and be|low, but|
|00003ce0| 20 64 69 66 66 65 72 65 | 6e 74 69 61 62 6c 65 29 | differe|ntiable)|
|00003cf0| 20 66 75 6e 63 74 69 6f | 6e 20 6f 66 20 61 20 77 | functio|n of a w|
|00003d00| 65 69 67 68 74 65 64 20 | 73 75 6d 20 6f 66 20 74 |eighted |sum of t|
|00003d10| 68 65 0a 20 20 20 6e 6f | 64 65 73 20 69 6e 70 75 |he.   no|des inpu|
|00003d20| 74 73 2e 0a 0a 20 20 20 | 54 68 65 20 75 73 65 20 |ts...   |The use |
|00003d30| 6f 66 20 61 20 67 72 61 | 64 69 65 6e 74 20 64 65 |of a gra|dient de|
|00003d40| 73 63 65 6e 74 20 61 6c | 67 6f 72 69 74 68 6d 20 |scent al|gorithm |
|00003d50| 74 6f 20 74 72 61 69 6e | 20 69 74 73 20 77 65 69 |to train| its wei|
|00003d60| 67 68 74 73 20 6d 61 6b | 65 73 0a 20 20 20 69 74 |ghts mak|es.   it|
|00003d70| 20 73 6c 6f 77 20 74 6f | 20 74 72 61 69 6e 3b 20 | slow to| train; |
|00003d80| 62 75 74 20 62 65 69 6e | 67 20 61 20 66 65 65 64 |but bein|g a feed|
|00003d90| 66 6f 72 77 61 72 64 20 | 61 6c 67 6f 72 69 74 68 |forward |algorith|
|00003da0| 6d 2c 20 69 74 20 69 73 | 20 71 75 69 74 65 20 72 |m, it is| quite r|
|00003db0| 61 70 69 64 0a 20 20 20 | 64 75 72 69 6e 67 20 74 |apid.   |during t|
|00003dc0| 68 65 20 72 65 63 61 6c | 6c 20 70 68 61 73 65 2e |he recal|l phase.|
|00003dd0| 0a 0a 20 20 20 4c 69 74 | 65 72 61 74 75 72 65 3a |..   Lit|erature:|
|00003de0| 0a 20 20 20 20 20 20 52 | 75 6d 65 6c 68 61 72 74 |.      R|umelhart|
|00003df0| 2c 20 44 2e 20 45 2e 20 | 61 6e 64 20 4d 63 43 6c |, D. E. |and McCl|
|00003e00| 65 6c 6c 61 6e 64 2c 20 | 4a 2e 20 4c 2e 20 28 31 |elland, |J. L. (1|
|00003e10| 39 38 36 29 3a 20 50 61 | 72 61 6c 6c 65 6c 0a 20 |986): Pa|rallel. |
|00003e20| 20 20 20 20 20 44 69 73 | 74 72 69 62 75 74 65 64 |     Dis|tributed|
|00003e30| 20 50 72 6f 63 65 73 73 | 69 6e 67 3a 20 45 78 70 | Process|ing: Exp|
|00003e40| 6c 6f 72 61 74 69 6f 6e | 73 20 69 6e 20 74 68 65 |loration|s in the|
|00003e50| 20 4d 69 63 72 6f 73 74 | 72 75 63 74 75 72 65 0a | Microst|ructure.|
|00003e60| 20 20 20 20 20 20 6f 66 | 20 43 6f 67 6e 69 74 69 |      of| Cogniti|
|00003e70| 6f 6e 20 28 76 6f 6c 75 | 6d 65 20 31 2c 20 70 70 |on (volu|me 1, pp|
|00003e80| 20 33 31 38 2d 33 36 32 | 29 2e 20 54 68 65 20 4d | 318-362|). The M|
|00003e90| 49 54 20 50 72 65 73 73 | 2e 20 0a 0a 20 20 20 28 |IT Press|. ..   (|
|00003ea0| 74 68 69 73 20 69 73 20 | 74 68 65 20 63 6c 61 73 |this is |the clas|
|00003eb0| 73 69 63 20 6f 6e 65 29 | 20 6f 72 20 6f 6e 65 20 |sic one)| or one |
|00003ec0| 6f 66 20 74 68 65 20 64 | 6f 7a 65 6e 73 20 6f 66 |of the d|ozens of|
|00003ed0| 20 6f 74 68 65 72 20 62 | 6f 6f 6b 73 20 6f 72 0a | other b|ooks or.|
|00003ee0| 20 20 20 61 72 74 69 63 | 6c 65 73 20 6f 6e 20 62 |   artic|les on b|
|00003ef0| 61 63 6b 70 72 6f 70 61 | 67 61 74 69 6f 6e 20 28 |ackpropa|gation (|
|00003f00| 73 65 65 20 61 6c 73 6f | 20 61 6e 73 77 65 72 20 |see also| answer |
|00003f10| 22 62 6f 6f 6b 73 22 29 | 2e 0a 0a 20 20 20 27 4f |"books")|...   'O|
|00003f20| 76 65 72 66 69 74 74 69 | 6e 67 27 20 28 6f 66 74 |verfitti|ng' (oft|
|00003f30| 65 6e 20 61 6c 73 6f 20 | 63 61 6c 6c 65 64 20 27 |en also |called '|
|00003f40| 6f 76 65 72 74 72 61 69 | 6e 69 6e 67 27 20 6f 72 |overtrai|ning' or|
|00003f50| 20 27 6f 76 65 72 6c 65 | 61 72 6e 69 6e 67 27 29 | 'overle|arning')|
|00003f60| 20 69 73 0a 20 20 20 74 | 68 65 20 70 68 65 6e 6f | is.   t|he pheno|
|00003f70| 6d 65 6e 6f 6e 20 74 68 | 61 74 20 69 6e 20 6d 6f |menon th|at in mo|
|00003f80| 73 74 20 63 61 73 65 73 | 20 61 20 6e 65 74 77 6f |st cases| a netwo|
|00003f90| 72 6b 20 67 65 74 73 20 | 77 6f 72 73 65 20 69 6e |rk gets |worse in|
|00003fa0| 73 74 65 61 64 0a 20 20 | 20 6f 66 20 62 65 74 74 |stead.  | of bett|
|00003fb0| 65 72 20 61 66 74 65 72 | 20 61 20 63 65 72 74 61 |er after| a certa|
|00003fc0| 69 6e 20 70 6f 69 6e 74 | 20 64 75 72 69 6e 67 20 |in point| during |
|00003fd0| 74 72 61 69 6e 69 6e 67 | 20 77 68 65 6e 20 69 74 |training| when it|
|00003fe0| 20 69 73 20 74 72 61 69 | 6e 65 64 20 74 6f 0a 20 | is trai|ned to. |
|00003ff0| 20 20 61 73 20 6c 6f 77 | 20 65 72 72 6f 72 73 20 |  as low| errors |
|00004000| 61 73 20 70 6f 73 73 69 | 62 6c 65 2e 20 54 68 69 |as possi|ble. Thi|
|00004010| 73 20 69 73 20 62 65 63 | 61 75 73 65 20 73 75 63 |s is bec|ause suc|
|00004020| 68 20 6c 6f 6e 67 20 74 | 72 61 69 6e 69 6e 67 20 |h long t|raining |
|00004030| 6d 61 79 0a 20 20 20 6d | 61 6b 65 20 74 68 65 20 |may.   m|ake the |
|00004040| 6e 65 74 77 6f 72 6b 20 | 27 6d 65 6d 6f 72 69 7a |network |'memoriz|
|00004050| 65 27 20 74 68 65 20 74 | 72 61 69 6e 69 6e 67 20 |e' the t|raining |
|00004060| 70 61 74 74 65 72 6e 73 | 2c 20 69 6e 63 6c 75 64 |patterns|, includ|
|00004070| 69 6e 67 20 61 6c 6c 0a | 20 20 20 6f 66 20 74 68 |ing all.|   of th|
|00004080| 65 69 72 20 70 65 63 75 | 6c 69 61 72 69 74 69 65 |eir pecu|liaritie|
|00004090| 73 2e 20 48 6f 77 65 76 | 65 72 2c 20 6f 6e 65 20 |s. Howev|er, one |
|000040a0| 69 73 20 75 73 75 61 6c | 6c 79 20 69 6e 74 65 72 |is usual|ly inter|
|000040b0| 65 73 74 65 64 20 69 6e | 20 74 68 65 0a 20 20 20 |ested in| the.   |
|000040c0| 67 65 6e 65 72 61 6c 69 | 7a 61 74 69 6f 6e 20 6f |generali|zation o|
|000040d0| 66 20 74 68 65 20 6e 65 | 74 77 6f 72 6b 2c 20 69 |f the ne|twork, i|
|000040e0| 2e 65 2e 2c 20 74 68 65 | 20 65 72 72 6f 72 20 69 |.e., the| error i|
|000040f0| 74 20 65 78 68 69 62 69 | 74 73 20 6f 6e 20 65 78 |t exhibi|ts on ex|
|00004100| 61 6d 70 6c 65 73 0a 20 | 20 20 4e 4f 54 20 73 65 |amples. |  NOT se|
|00004110| 65 6e 20 64 75 72 69 6e | 67 20 74 72 61 69 6e 69 |en durin|g traini|
|00004120| 6e 67 2e 20 4c 65 61 72 | 6e 69 6e 67 20 74 68 65 |ng. Lear|ning the|
|00004130| 20 70 65 63 75 6c 69 61 | 72 69 74 69 65 73 20 6f | peculia|rities o|
|00004140| 66 20 74 68 65 0a 20 20 | 20 74 72 61 69 6e 69 6e |f the.  | trainin|
|00004150| 67 20 73 65 74 20 6d 61 | 6b 65 73 20 74 68 65 20 |g set ma|kes the |
|00004160| 67 65 6e 65 72 61 6c 69 | 7a 61 74 69 6f 6e 20 77 |generali|zation w|
|00004170| 6f 72 73 65 2e 20 54 68 | 65 20 6e 65 74 77 6f 72 |orse. Th|e networ|
|00004180| 6b 20 73 68 6f 75 6c 64 | 0a 20 20 20 6f 6e 6c 79 |k should|.   only|
|00004190| 20 6c 65 61 72 6e 20 74 | 68 65 20 67 65 6e 65 72 | learn t|he gener|
|000041a0| 61 6c 20 73 74 72 75 63 | 74 75 72 65 20 6f 66 20 |al struc|ture of |
|000041b0| 74 68 65 20 65 78 61 6d | 70 6c 65 73 2e 20 0a 0a |the exam|ples. ..|
|000041c0| 20 20 20 54 68 65 72 65 | 20 61 72 65 20 76 61 72 |   There| are var|
|000041d0| 69 6f 75 73 20 6d 65 74 | 68 6f 64 73 20 74 6f 20 |ious met|hods to |
|000041e0| 66 69 67 68 74 20 6f 76 | 65 72 66 69 74 74 69 6e |fight ov|erfittin|
|000041f0| 67 2e 20 54 68 65 20 74 | 77 6f 20 6d 6f 73 74 0a |g. The t|wo most.|
|00004200| 20 20 20 69 6d 70 6f 72 | 74 61 6e 74 20 63 6c 61 |   impor|tant cla|
|00004210| 73 73 65 73 20 6f 66 20 | 73 75 63 68 20 6d 65 74 |sses of |such met|
|00004220| 68 6f 64 73 20 61 72 65 | 20 72 65 67 75 6c 61 72 |hods are| regular|
|00004230| 69 7a 61 74 69 6f 6e 20 | 6d 65 74 68 6f 64 73 0a |ization |methods.|
|00004240| 20 20 20 28 73 75 63 68 | 20 61 73 20 77 65 69 67 |   (such| as weig|
|00004250| 68 74 20 64 65 63 61 79 | 29 20 61 6e 64 20 65 61 |ht decay|) and ea|
|00004260| 72 6c 79 20 73 74 6f 70 | 70 69 6e 67 2e 20 52 65 |rly stop|ping. Re|
|00004270| 67 75 6c 61 72 69 7a 61 | 74 69 6f 6e 0a 20 20 20 |gulariza|tion.   |
|00004280| 6d 65 74 68 6f 64 73 20 | 74 72 79 20 74 6f 20 6c |methods |try to l|
|00004290| 69 6d 69 74 20 74 68 65 | 20 63 6f 6d 70 6c 65 78 |imit the| complex|
|000042a0| 69 74 79 20 6f 66 20 74 | 68 65 20 6e 65 74 77 6f |ity of t|he netwo|
|000042b0| 72 6b 20 73 75 63 68 20 | 74 68 61 74 20 69 74 20 |rk such |that it |
|000042c0| 69 73 0a 20 20 20 75 6e | 61 62 6c 65 20 74 6f 20 |is.   un|able to |
|000042d0| 6c 65 61 72 6e 20 70 65 | 63 75 6c 69 61 72 69 74 |learn pe|culiarit|
|000042e0| 69 65 73 2e 20 45 61 72 | 6c 79 20 73 74 6f 70 70 |ies. Ear|ly stopp|
|000042f0| 69 6e 67 20 61 69 6d 73 | 20 61 74 20 73 74 6f 70 |ing aims| at stop|
|00004300| 70 69 6e 67 20 74 68 65 | 0a 20 20 20 74 72 61 69 |ping the|.   trai|
|00004310| 6e 69 6e 67 20 61 74 20 | 74 68 65 20 70 6f 69 6e |ning at |the poin|
|00004320| 74 20 6f 66 20 6f 70 74 | 69 6d 61 6c 20 67 65 6e |t of opt|imal gen|
|00004330| 65 72 61 6c 69 7a 61 74 | 69 6f 6e 2e 20 41 20 64 |eralizat|ion. A d|
|00004340| 65 73 63 72 69 70 74 69 | 6f 6e 20 6f 66 20 74 68 |escripti|on of th|
|00004350| 65 0a 20 20 20 65 61 72 | 6c 79 20 73 74 6f 70 70 |e.   ear|ly stopp|
|00004360| 69 6e 67 20 6d 65 74 68 | 6f 64 20 63 61 6e 20 66 |ing meth|od can f|
|00004370| 6f 72 20 69 6e 73 74 61 | 6e 63 65 20 62 65 20 66 |or insta|nce be f|
|00004380| 6f 75 6e 64 20 69 6e 20 | 73 65 63 74 69 6f 6e 20 |ound in |section |
|00004390| 33 2e 33 20 6f 66 20 0a | 20 20 20 2f 70 75 62 2f |3.3 of .|   /pub/|
|000043a0| 70 61 70 65 72 73 2f 74 | 65 63 68 72 65 70 6f 72 |papers/t|echrepor|
|000043b0| 74 73 2f 31 39 39 34 2d | 32 31 2e 70 73 2e 5a 20 |ts/1994-|21.ps.Z |
|000043c0| 6f 6e 20 66 74 70 2e 69 | 72 61 2e 75 6b 61 2e 64 |on ftp.i|ra.uka.d|
|000043d0| 65 0a 20 20 20 28 61 6e | 6f 6e 79 6d 6f 75 73 20 |e.   (an|onymous |
|000043e0| 66 74 70 29 2e 20 0a 0a | 20 20 20 2d 2d 2d 2d 2d |ftp). ..|   -----|
|000043f0| 2d 2d 2d 2d 2d 2d 2d 2d | 2d 2d 2d 2d 2d 2d 2d 2d |--------|--------|
|00004400| 2d 2d 2d 2d 2d 2d 2d 2d | 2d 2d 2d 2d 2d 2d 2d 2d |--------|--------|
|00004410| 2d 2d 2d 2d 2d 2d 2d 2d | 2d 2d 2d 2d 2d 2d 2d 2d |--------|--------|
|00004420| 2d 2d 2d 2d 2d 2d 2d 2d | 2d 2d 2d 2d 2d 2d 2d 2d |--------|--------|
|00004430| 2d 2d 2d 0a 0a 20 36 2e | 20 41 3a 20 57 68 79 20 |---.. 6.| A: Why |
|00004440| 75 73 65 20 61 20 62 69 | 61 73 20 69 6e 70 75 74 |use a bi|as input|
|00004450| 3f 20 57 68 79 20 61 63 | 74 69 76 61 74 69 6f 6e |? Why ac|tivation|
|00004460| 0a 20 3d 3d 3d 3d 3d 3d | 3d 3d 3d 3d 3d 3d 3d 3d |. ======|========|
|00004470| 3d 3d 3d 3d 3d 3d 3d 3d | 3d 3d 3d 3d 3d 3d 3d 3d |========|========|
|00004480| 3d 3d 3d 3d 3d 3d 3d 3d | 3d 3d 3d 3d 0a 20 20 20 |========|====.   |
|00004490| 66 75 6e 63 74 69 6f 6e | 73 3f 20 0a 20 20 20 3d |function|s? .   =|
|000044a0| 3d 3d 3d 3d 3d 3d 3d 3d | 3d 3d 0a 0a 20 20 20 4f |========|==..   O|
|000044b0| 6e 65 20 77 61 79 20 6f | 66 20 6c 6f 6f 6b 69 6e |ne way o|f lookin|
|000044c0| 67 20 61 74 20 74 68 65 | 20 6e 65 65 64 20 66 6f |g at the| need fo|
|000044d0| 72 20 62 69 61 73 20 69 | 6e 70 75 74 73 20 69 73 |r bias i|nputs is|
|000044e0| 20 74 68 61 74 20 74 68 | 65 20 69 6e 70 75 74 73 | that th|e inputs|
|000044f0| 20 74 6f 0a 20 20 20 65 | 61 63 68 20 75 6e 69 74 | to.   e|ach unit|
|00004500| 20 69 6e 20 74 68 65 20 | 6e 65 74 20 64 65 66 69 | in the |net defi|
|00004510| 6e 65 20 61 6e 20 4e 2d | 64 69 6d 65 6e 73 69 6f |ne an N-|dimensio|
|00004520| 6e 61 6c 20 73 70 61 63 | 65 2c 20 61 6e 64 20 74 |nal spac|e, and t|
|00004530| 68 65 20 75 6e 69 74 0a | 20 20 20 64 72 61 77 73 |he unit.|   draws|
|00004540| 20 61 20 68 79 70 65 72 | 70 6c 61 6e 65 20 74 68 | a hyper|plane th|
|00004550| 72 6f 75 67 68 20 74 68 | 61 74 20 73 70 61 63 65 |rough th|at space|
|00004560| 2c 20 70 72 6f 64 75 63 | 69 6e 67 20 61 6e 20 22 |, produc|ing an "|
|00004570| 6f 6e 22 20 6f 75 74 70 | 75 74 0a 20 20 20 6f 6e |on" outp|ut.   on|
|00004580| 20 6f 6e 65 20 73 69 64 | 65 20 61 6e 64 20 61 6e | one sid|e and an|
|00004590| 20 22 6f 66 66 22 20 6f | 75 74 70 75 74 20 6f 6e | "off" o|utput on|
|000045a0| 20 74 68 65 20 6f 74 68 | 65 72 2e 20 28 57 69 74 | the oth|er. (Wit|
|000045b0| 68 20 73 69 67 6d 6f 69 | 64 20 75 6e 69 74 73 0a |h sigmoi|d units.|
|000045c0| 20 20 20 74 68 65 20 70 | 6c 61 6e 65 20 77 69 6c |   the p|lane wil|
|000045d0| 6c 20 6e 6f 74 20 62 65 | 20 73 68 61 72 70 20 2d |l not be| sharp -|
|000045e0| 2d 20 74 68 65 72 65 20 | 77 69 6c 6c 20 62 65 20 |- there |will be |
|000045f0| 73 6f 6d 65 20 67 72 61 | 79 20 61 72 65 61 20 6f |some gra|y area o|
|00004600| 66 0a 20 20 20 69 6e 74 | 65 72 6d 65 64 69 61 74 |f.   int|ermediat|
|00004610| 65 20 76 61 6c 75 65 73 | 20 6e 65 61 72 20 74 68 |e values| near th|
|00004620| 65 20 73 65 70 61 72 61 | 74 69 6e 67 20 70 6c 61 |e separa|ting pla|
|00004630| 6e 65 20 2d 2d 20 62 75 | 74 20 69 67 6e 6f 72 65 |ne -- bu|t ignore|
|00004640| 20 74 68 69 73 0a 20 20 | 20 66 6f 72 20 6e 6f 77 | this.  | for now|
|00004650| 2e 29 0a 20 20 20 54 68 | 65 20 77 65 69 67 68 74 |.).   Th|e weight|
|00004660| 73 20 64 65 74 65 72 6d | 69 6e 65 20 77 68 65 72 |s determ|ine wher|
|00004670| 65 20 74 68 69 73 20 68 | 79 70 65 72 70 6c 61 6e |e this h|yperplan|
|00004680| 65 20 69 73 20 69 6e 20 | 74 68 65 20 69 6e 70 75 |e is in |the inpu|
|00004690| 74 20 73 70 61 63 65 2e | 0a 20 20 20 57 69 74 68 |t space.|.   With|
|000046a0| 6f 75 74 20 61 20 62 69 | 61 73 20 69 6e 70 75 74 |out a bi|as input|
|000046b0| 2c 20 74 68 69 73 20 73 | 65 70 61 72 61 74 69 6e |, this s|eparatin|
|000046c0| 67 20 70 6c 61 6e 65 20 | 69 73 20 63 6f 6e 73 74 |g plane |is const|
|000046d0| 72 61 69 6e 65 64 20 74 | 6f 20 70 61 73 73 0a 20 |rained t|o pass. |
|000046e0| 20 20 74 68 72 6f 75 67 | 68 20 74 68 65 20 6f 72 |  throug|h the or|
|000046f0| 69 67 69 6e 20 6f 66 20 | 74 68 65 20 68 79 70 65 |igin of |the hype|
|00004700| 72 73 70 61 63 65 20 64 | 65 66 69 6e 65 64 20 62 |rspace d|efined b|
|00004710| 79 20 74 68 65 20 69 6e | 70 75 74 73 2e 20 46 6f |y the in|puts. Fo|
|00004720| 72 0a 20 20 20 73 6f 6d | 65 20 70 72 6f 62 6c 65 |r.   som|e proble|
|00004730| 6d 73 20 74 68 61 74 27 | 73 20 4f 4b 2c 20 62 75 |ms that'|s OK, bu|
|00004740| 74 20 69 6e 20 6d 61 6e | 79 20 70 72 6f 62 6c 65 |t in man|y proble|
|00004750| 6d 73 20 74 68 65 20 70 | 6c 61 6e 65 20 77 6f 75 |ms the p|lane wou|
|00004760| 6c 64 0a 20 20 20 62 65 | 20 6d 75 63 68 20 6d 6f |ld.   be| much mo|
|00004770| 72 65 20 75 73 65 66 75 | 6c 20 73 6f 6d 65 77 68 |re usefu|l somewh|
|00004780| 65 72 65 20 65 6c 73 65 | 2e 20 49 66 20 79 6f 75 |ere else|. If you|
|00004790| 20 68 61 76 65 20 6d 61 | 6e 79 20 75 6e 69 74 73 | have ma|ny units|
|000047a0| 20 69 6e 20 61 0a 20 20 | 20 6c 61 79 65 72 2c 20 | in a.  | layer, |
|000047b0| 74 68 65 79 20 73 68 61 | 72 65 20 74 68 65 20 73 |they sha|re the s|
|000047c0| 61 6d 65 20 69 6e 70 75 | 74 20 73 70 61 63 65 20 |ame inpu|t space |
|000047d0| 61 6e 64 20 77 69 74 68 | 6f 75 74 20 62 69 61 73 |and with|out bias|
|000047e0| 20 77 6f 75 6c 64 0a 20 | 20 20 41 4c 4c 20 62 65 | would. |  ALL be|
|000047f0| 20 63 6f 6e 73 74 72 61 | 69 6e 65 64 20 74 6f 20 | constra|ined to |
|00004800| 70 61 73 73 20 74 68 72 | 6f 75 67 68 20 74 68 65 |pass thr|ough the|
|00004810| 20 6f 72 69 67 69 6e 2e | 20 0a 0a 20 20 20 41 63 | origin.| ..   Ac|
|00004820| 74 69 76 61 74 69 6f 6e | 20 66 75 6e 63 74 69 6f |tivation| functio|
|00004830| 6e 73 20 61 72 65 20 6e | 65 65 64 65 64 20 74 6f |ns are n|eeded to|
|00004840| 20 69 6e 74 72 6f 64 75 | 63 65 20 6e 6f 6e 6c 69 | introdu|ce nonli|
|00004850| 6e 65 61 72 69 74 79 20 | 69 6e 74 6f 20 74 68 65 |nearity |into the|
|00004860| 0a 20 20 20 6e 65 74 77 | 6f 72 6b 2e 20 57 69 74 |.   netw|ork. Wit|
|00004870| 68 6f 75 74 20 6e 6f 6e | 6c 69 6e 65 61 72 69 74 |hout non|linearit|
|00004880| 79 2c 20 68 69 64 64 65 | 6e 20 75 6e 69 74 73 20 |y, hidde|n units |
|00004890| 77 6f 75 6c 64 20 6e 6f | 74 20 6d 61 6b 65 20 6e |would no|t make n|
|000048a0| 65 74 73 0a 20 20 20 6d | 6f 72 65 20 70 6f 77 65 |ets.   m|ore powe|
|000048b0| 72 66 75 6c 20 74 68 61 | 6e 20 6a 75 73 74 20 70 |rful tha|n just p|
|000048c0| 6c 61 69 6e 20 70 65 72 | 63 65 70 74 72 6f 6e 73 |lain per|ceptrons|
|000048d0| 20 28 77 68 69 63 68 20 | 64 6f 20 6e 6f 74 20 68 | (which |do not h|
|000048e0| 61 76 65 20 61 6e 79 0a | 20 20 20 68 69 64 64 65 |ave any.|   hidde|
|000048f0| 6e 20 75 6e 69 74 73 2c | 20 6a 75 73 74 20 69 6e |n units,| just in|
|00004900| 70 75 74 20 61 6e 64 20 | 6f 75 74 70 75 74 20 75 |put and |output u|
|00004910| 6e 69 74 73 29 2e 20 54 | 68 65 20 72 65 61 73 6f |nits). T|he reaso|
|00004920| 6e 20 69 73 20 74 68 61 | 74 20 61 0a 20 20 20 63 |n is tha|t a.   c|
|00004930| 6f 6d 70 6f 73 69 74 69 | 6f 6e 20 6f 66 20 6c 69 |ompositi|on of li|
|00004940| 6e 65 61 72 20 66 75 6e | 63 74 69 6f 6e 73 20 69 |near fun|ctions i|
|00004950| 73 20 61 67 61 69 6e 20 | 61 20 6c 69 6e 65 61 72 |s again |a linear|
|00004960| 20 66 75 6e 63 74 69 6f | 6e 2e 0a 20 20 20 48 6f | functio|n..   Ho|
|00004970| 77 65 76 65 72 2c 20 69 | 74 20 69 73 20 6a 75 73 |wever, i|t is jus|
|00004980| 74 20 74 68 65 20 6e 6f | 6e 6c 69 6e 65 61 72 69 |t the no|nlineari|
|00004990| 74 79 20 28 69 2e 65 2c | 20 74 68 65 20 63 61 70 |ty (i.e,| the cap|
|000049a0| 61 62 69 6c 69 74 79 20 | 74 6f 20 72 65 70 72 65 |ability |to repre|
|000049b0| 73 65 6e 74 0a 20 20 20 | 6e 6f 6e 6c 69 6e 65 61 |sent.   |nonlinea|
|000049c0| 72 20 66 75 6e 63 74 69 | 6f 6e 73 29 20 74 68 61 |r functi|ons) tha|
|000049d0| 74 20 6d 61 6b 65 73 20 | 6d 75 6c 74 69 6c 61 79 |t makes |multilay|
|000049e0| 65 72 20 6e 65 74 77 6f | 72 6b 73 20 73 6f 20 70 |er netwo|rks so p|
|000049f0| 6f 77 65 72 66 75 6c 2e | 0a 20 20 20 41 6c 6d 6f |owerful.|.   Almo|
|00004a00| 73 74 20 61 6e 79 20 6e | 6f 6e 6c 69 6e 65 61 72 |st any n|onlinear|
|00004a10| 20 66 75 6e 63 74 69 6f | 6e 20 64 6f 65 73 20 74 | functio|n does t|
|00004a20| 68 65 20 6a 6f 62 2c 20 | 61 6c 74 68 6f 75 67 68 |he job, |although|
|00004a30| 20 66 6f 72 0a 20 20 20 | 62 61 63 6b 70 72 6f 70 | for.   |backprop|
|00004a40| 61 67 61 74 69 6f 6e 20 | 6c 65 61 72 6e 69 6e 67 |agation |learning|
|00004a50| 20 69 74 20 6d 75 73 74 | 20 62 65 20 64 69 66 66 | it must| be diff|
|00004a60| 65 72 65 6e 74 69 61 62 | 6c 65 20 61 6e 64 20 69 |erentiab|le and i|
|00004a70| 74 20 68 65 6c 70 73 20 | 69 66 0a 20 20 20 74 68 |t helps |if.   th|
|00004a80| 65 20 66 75 6e 63 74 69 | 6f 6e 20 69 73 20 62 6f |e functi|on is bo|
|00004a90| 75 6e 64 65 64 3b 20 74 | 68 65 20 70 6f 70 75 6c |unded; t|he popul|
|00004aa0| 61 72 20 73 69 67 6d 6f | 69 64 61 6c 20 66 75 6e |ar sigmo|idal fun|
|00004ab0| 63 74 69 6f 6e 73 20 61 | 6e 64 0a 20 20 20 67 61 |ctions a|nd.   ga|
|00004ac0| 75 73 73 69 61 6e 20 66 | 75 6e 63 74 69 6f 6e 73 |ussian f|unctions|
|00004ad0| 20 61 72 65 20 74 68 65 | 20 6d 6f 73 74 20 63 6f | are the| most co|
|00004ae0| 6d 6d 6f 6e 20 63 68 6f | 69 63 65 73 2e 0a 0a 20 |mmon cho|ices... |
|00004af0| 20 20 2d 2d 2d 2d 2d 2d | 2d 2d 2d 2d 2d 2d 2d 2d |  ------|--------|
|00004b00| 2d 2d 2d 2d 2d 2d 2d 2d | 2d 2d 2d 2d 2d 2d 2d 2d |--------|--------|
|00004b10| 2d 2d 2d 2d 2d 2d 2d 2d | 2d 2d 2d 2d 2d 2d 2d 2d |--------|--------|
|00004b20| 2d 2d 2d 2d 2d 2d 2d 2d | 2d 2d 2d 2d 2d 2d 2d 2d |--------|--------|
|00004b30| 2d 2d 2d 2d 2d 2d 2d 2d | 2d 2d 0a 0a 20 37 2e 20 |--------|--.. 7. |
|00004b40| 41 3a 20 48 6f 77 20 6d | 61 6e 79 20 68 69 64 64 |A: How m|any hidd|
|00004b50| 65 6e 20 75 6e 69 74 73 | 20 73 68 6f 75 6c 64 20 |en units| should |
|00004b60| 49 20 75 73 65 3f 20 0a | 20 3d 3d 3d 3d 3d 3d 3d |I use? .| =======|
|00004b70| 3d 3d 3d 3d 3d 3d 3d 3d | 3d 3d 3d 3d 3d 3d 3d 3d |========|========|
|00004b80| 3d 3d 3d 3d 3d 3d 3d 3d | 3d 3d 3d 3d 3d 3d 3d 3d |========|========|
|00004b90| 3d 3d 3d 0a 0a 20 20 20 | 54 68 65 72 65 20 69 73 |===..   |There is|
|00004ba0| 20 6e 6f 20 77 61 79 20 | 74 6f 20 64 65 74 65 72 | no way |to deter|
|00004bb0| 6d 69 6e 65 20 61 20 67 | 6f 6f 64 20 6e 65 74 77 |mine a g|ood netw|
|00004bc0| 6f 72 6b 20 74 6f 70 6f | 6c 6f 67 79 20 6a 75 73 |ork topo|logy jus|
|00004bd0| 74 20 66 72 6f 6d 0a 20 | 20 20 74 68 65 20 6e 75 |t from. |  the nu|
|00004be0| 6d 62 65 72 20 6f 66 20 | 69 6e 70 75 74 73 20 61 |mber of |inputs a|
|00004bf0| 6e 64 20 6f 75 74 70 75 | 74 73 2e 20 49 74 20 64 |nd outpu|ts. It d|
|00004c00| 65 70 65 6e 64 73 20 63 | 72 69 74 69 63 61 6c 6c |epends c|riticall|
|00004c10| 79 20 6f 6e 20 74 68 65 | 0a 20 20 20 6e 75 6d 62 |y on the|.   numb|
|00004c20| 65 72 20 6f 66 20 74 72 | 61 69 6e 69 6e 67 20 65 |er of tr|aining e|
|00004c30| 78 61 6d 70 6c 65 73 20 | 61 6e 64 20 74 68 65 20 |xamples |and the |
|00004c40| 63 6f 6d 70 6c 65 78 69 | 74 79 20 6f 66 20 74 68 |complexi|ty of th|
|00004c50| 65 0a 20 20 20 63 6c 61 | 73 73 69 66 69 63 61 74 |e.   cla|ssificat|
|00004c60| 69 6f 6e 20 79 6f 75 20 | 61 72 65 20 74 72 79 69 |ion you |are tryi|
|00004c70| 6e 67 20 74 6f 20 6c 65 | 61 72 6e 2e 20 54 68 65 |ng to le|arn. The|
|00004c80| 72 65 20 61 72 65 20 70 | 72 6f 62 6c 65 6d 73 20 |re are p|roblems |
|00004c90| 77 69 74 68 20 6f 6e 65 | 0a 20 20 20 69 6e 70 75 |with one|.   inpu|
|00004ca0| 74 20 61 6e 64 20 6f 6e | 65 20 6f 75 74 70 75 74 |t and on|e output|
|00004cb0| 20 74 68 61 74 20 72 65 | 71 75 69 72 65 20 6d 69 | that re|quire mi|
|00004cc0| 6c 6c 69 6f 6e 73 20 6f | 66 20 68 69 64 64 65 6e |llions o|f hidden|
|00004cd0| 20 75 6e 69 74 73 2c 20 | 61 6e 64 0a 20 20 20 70 | units, |and.   p|
|00004ce0| 72 6f 62 6c 65 6d 73 20 | 77 69 74 68 20 61 20 6d |roblems |with a m|
|00004cf0| 69 6c 6c 69 6f 6e 20 69 | 6e 70 75 74 73 20 61 6e |illion i|nputs an|
|00004d00| 64 20 61 20 6d 69 6c 6c | 69 6f 6e 20 6f 75 74 70 |d a mill|ion outp|
|00004d10| 75 74 73 20 74 68 61 74 | 20 72 65 71 75 69 72 65 |uts that| require|
|00004d20| 0a 20 20 20 6f 6e 6c 79 | 20 6f 6e 65 20 68 69 64 |.   only| one hid|
|00004d30| 64 65 6e 20 75 6e 69 74 | 2c 20 6f 72 20 6e 6f 6e |den unit|, or non|
|00004d40| 65 20 61 74 20 61 6c 6c | 2e 0a 20 20 20 53 6f 6d |e at all|..   Som|
|00004d50| 65 20 62 6f 6f 6b 73 20 | 61 6e 64 20 61 72 74 69 |e books |and arti|
|00004d60| 63 6c 65 73 20 6f 66 66 | 65 72 20 22 72 75 6c 65 |cles off|er "rule|
|00004d70| 73 20 6f 66 20 74 68 75 | 6d 62 22 20 66 6f 72 20 |s of thu|mb" for |
|00004d80| 63 68 6f 6f 73 69 6e 67 | 20 61 0a 20 20 20 74 6f |choosing| a.   to|
|00004d90| 70 6f 70 6f 6c 6f 67 79 | 20 2d 2d 20 4e 69 6e 70 |popology| -- Ninp|
|00004da0| 75 74 73 20 70 6c 75 73 | 20 4e 6f 75 74 70 75 74 |uts plus| Noutput|
|00004db0| 73 20 64 69 76 69 64 69 | 65 64 20 62 79 20 74 77 |s dividi|ed by tw|
|00004dc0| 6f 2c 20 6d 61 79 62 65 | 20 77 69 74 68 0a 20 20 |o, maybe| with.  |
|00004dd0| 20 61 20 73 71 75 61 72 | 65 20 72 6f 6f 74 20 69 | a squar|e root i|
|00004de0| 6e 20 74 68 65 72 65 20 | 73 6f 6d 65 77 68 65 72 |n there |somewher|
|00004df0| 65 20 2d 2d 20 62 75 74 | 20 73 75 63 68 20 72 75 |e -- but| such ru|
|00004e00| 6c 65 73 20 61 72 65 20 | 74 6f 74 61 6c 0a 20 20 |les are |total.  |
|00004e10| 20 67 61 72 62 61 67 65 | 2e 20 4f 74 68 65 72 20 | garbage|. Other |
|00004e20| 72 75 6c 65 73 20 72 65 | 6c 61 74 65 20 74 6f 20 |rules re|late to |
|00004e30| 74 68 65 20 6e 75 6d 62 | 65 72 20 6f 66 20 65 78 |the numb|er of ex|
|00004e40| 61 6d 70 6c 65 73 20 61 | 76 61 69 6c 61 62 6c 65 |amples a|vailable|
|00004e50| 3a 0a 20 20 20 55 73 65 | 20 61 74 20 6d 6f 73 74 |:.   Use| at most|
|00004e60| 20 73 6f 20 6d 61 6e 79 | 20 68 69 64 64 65 6e 20 | so many| hidden |
|00004e70| 75 6e 69 74 73 20 74 68 | 61 74 20 74 68 65 20 6e |units th|at the n|
|00004e80| 75 6d 62 65 72 20 6f 66 | 20 77 65 69 67 68 74 73 |umber of| weights|
|00004e90| 20 69 6e 0a 20 20 20 74 | 68 65 20 6e 65 74 77 6f | in.   t|he netwo|
|00004ea0| 72 6b 20 74 69 6d 65 73 | 20 31 30 20 69 73 20 73 |rk times| 10 is s|
|00004eb0| 6d 61 6c 6c 65 72 20 74 | 68 61 6e 20 74 68 65 20 |maller t|han the |
|00004ec0| 6e 75 6d 62 65 72 20 6f | 66 20 65 78 61 6d 70 6c |number o|f exampl|
|00004ed0| 65 73 2e 0a 20 20 20 53 | 75 63 68 20 72 75 6c 65 |es..   S|uch rule|
|00004ee0| 73 20 61 72 65 20 6f 6e | 6c 79 20 63 6f 6e 63 65 |s are on|ly conce|
|00004ef0| 72 6e 65 64 20 77 69 74 | 68 20 6f 76 65 72 66 69 |rned wit|h overfi|
|00004f00| 74 74 69 6e 67 20 61 6e | 64 20 61 72 65 20 75 6e |tting an|d are un|
|00004f10| 72 65 6c 69 61 62 6c 65 | 0a 20 20 20 61 73 20 77 |reliable|.   as w|
|00004f20| 65 6c 6c 2e 20 0a 0a 20 | 20 20 2d 2d 2d 2d 2d 2d |ell. .. |  ------|
|00004f30| 2d 2d 2d 2d 2d 2d 2d 2d | 2d 2d 2d 2d 2d 2d 2d 2d |--------|--------|
|00004f40| 2d 2d 2d 2d 2d 2d 2d 2d | 2d 2d 2d 2d 2d 2d 2d 2d |--------|--------|
|00004f50| 2d 2d 2d 2d 2d 2d 2d 2d | 2d 2d 2d 2d 2d 2d 2d 2d |--------|--------|
|00004f60| 2d 2d 2d 2d 2d 2d 2d 2d | 2d 2d 2d 2d 2d 2d 2d 2d |--------|--------|
|00004f70| 2d 2d 0a 0a 20 38 2e 20 | 41 3a 20 48 6f 77 20 6d |--.. 8. |A: How m|
|00004f80| 61 6e 79 20 6c 65 61 72 | 6e 69 6e 67 20 6d 65 74 |any lear|ning met|
|00004f90| 68 6f 64 73 20 66 6f 72 | 20 4e 4e 73 20 65 78 69 |hods for| NNs exi|
|00004fa0| 73 74 3f 0a 20 3d 3d 3d | 3d 3d 3d 3d 3d 3d 3d 3d |st?. ===|========|
|00004fb0| 3d 3d 3d 3d 3d 3d 3d 3d | 3d 3d 3d 3d 3d 3d 3d 3d |========|========|
|00004fc0| 3d 3d 3d 3d 3d 3d 3d 3d | 3d 3d 3d 3d 3d 3d 3d 3d |========|========|
|00004fd0| 3d 3d 3d 0a 20 20 20 57 | 68 69 63 68 3f 0a 20 20 |===.   W|hich?.  |
|00004fe0| 20 3d 3d 3d 3d 3d 3d 0a | 0a 20 20 20 54 68 65 72 | ======.|.   Ther|
|00004ff0| 65 20 61 72 65 20 6d 61 | 6e 79 20 6d 61 6e 79 20 |e are ma|ny many |
|00005000| 6c 65 61 72 6e 69 6e 67 | 20 6d 65 74 68 6f 64 73 |learning| methods|
|00005010| 20 66 6f 72 20 4e 4e 73 | 20 62 79 20 6e 6f 77 2e | for NNs| by now.|
|00005020| 20 4e 6f 62 6f 64 79 0a | 20 20 20 6b 6e 6f 77 73 | Nobody.|   knows|
|00005030| 20 65 78 61 63 74 6c 79 | 20 68 6f 77 20 6d 61 6e | exactly| how man|
|00005040| 79 2e 20 4e 65 77 20 6f | 6e 65 73 20 28 61 74 20 |y. New o|nes (at |
|00005050| 6c 65 61 73 74 20 76 61 | 72 69 61 74 69 6f 6e 73 |least va|riations|
|00005060| 20 6f 66 20 65 78 69 73 | 74 69 6e 67 0a 20 20 20 | of exis|ting.   |
|00005070| 6f 6e 65 73 29 20 61 72 | 65 20 69 6e 76 65 6e 74 |ones) ar|e invent|
|00005080| 65 64 20 65 76 65 72 79 | 20 77 65 65 6b 2e 20 42 |ed every| week. B|
|00005090| 65 6c 6f 77 20 69 73 20 | 61 20 63 6f 6c 6c 65 63 |elow is |a collec|
|000050a0| 74 69 6f 6e 20 6f 66 20 | 73 6f 6d 65 20 6f 66 20 |tion of |some of |
|000050b0| 74 68 65 0a 20 20 20 6d | 6f 73 74 20 77 65 6c 6c |the.   m|ost well|
|000050c0| 20 6b 6e 6f 77 6e 20 6d | 65 74 68 6f 64 73 3b 20 | known m|ethods; |
|000050d0| 6e 6f 74 20 63 6c 61 69 | 6d 69 6e 67 20 74 6f 20 |not clai|ming to |
|000050e0| 62 65 20 63 6f 6d 70 6c | 65 74 65 2e 0a 0a 20 20 |be compl|ete...  |
|000050f0| 20 54 68 65 20 6d 61 69 | 6e 20 63 61 74 65 67 6f | The mai|n catego|
|00005100| 72 69 7a 61 74 69 6f 6e | 20 6f 66 20 74 68 65 73 |rization| of thes|
|00005110| 65 20 6d 65 74 68 6f 64 | 73 20 69 73 20 74 68 65 |e method|s is the|
|00005120| 20 64 69 73 74 69 6e 63 | 74 69 6f 6e 20 6f 66 0a | distinc|tion of.|
|00005130| 20 20 20 73 75 70 65 72 | 76 69 73 65 64 20 66 72 |   super|vised fr|
|00005140| 6f 6d 20 75 6e 73 75 70 | 65 72 76 69 73 65 64 20 |om unsup|ervised |
|00005150| 6c 65 61 72 6e 69 6e 67 | 3a 0a 0a 20 20 20 49 6e |learning|:..   In|
|00005160| 20 73 75 70 65 72 76 69 | 73 65 64 20 6c 65 61 72 | supervi|sed lear|
|00005170| 6e 69 6e 67 2c 20 74 68 | 65 72 65 20 69 73 20 61 |ning, th|ere is a|
|00005180| 20 22 74 65 61 63 68 65 | 72 22 20 77 68 6f 20 69 | "teache|r" who i|
|00005190| 6e 20 74 68 65 20 6c 65 | 61 72 6e 69 6e 67 0a 20 |n the le|arning. |
|000051a0| 20 20 70 68 61 73 65 20 | 22 74 65 6c 6c 73 22 20 |  phase |"tells" |
|000051b0| 74 68 65 20 6e 65 74 20 | 68 6f 77 20 77 65 6c 6c |the net |how well|
|000051c0| 20 69 74 20 70 65 72 66 | 6f 72 6d 73 20 28 22 72 | it perf|orms ("r|
|000051d0| 65 69 6e 66 6f 72 63 65 | 6d 65 6e 74 0a 20 20 20 |einforce|ment.   |
|000051e0| 6c 65 61 72 6e 69 6e 67 | 22 29 20 6f 72 20 77 68 |learning|") or wh|
|000051f0| 61 74 20 74 68 65 20 63 | 6f 72 72 65 63 74 20 62 |at the c|orrect b|
|00005200| 65 68 61 76 69 6f 72 20 | 77 6f 75 6c 64 20 68 61 |ehavior |would ha|
|00005210| 76 65 20 62 65 65 6e 20 | 28 22 66 75 6c 6c 79 0a |ve been |("fully.|
|00005220| 20 20 20 73 75 70 65 72 | 76 69 73 65 64 20 6c 65 |   super|vised le|
|00005230| 61 72 6e 69 6e 67 22 29 | 2e 0a 0a 20 20 20 49 6e |arning")|...   In|
|00005240| 20 75 6e 73 75 70 65 72 | 76 69 73 65 64 20 6c 65 | unsuper|vised le|
|00005250| 61 72 6e 69 6e 67 20 74 | 68 65 20 6e 65 74 20 69 |arning t|he net i|
|00005260| 73 20 61 75 74 6f 6e 6f | 6d 6f 75 73 3a 20 69 74 |s autono|mous: it|
|00005270| 20 6a 75 73 74 20 6c 6f | 6f 6b 73 20 61 74 20 74 | just lo|oks at t|
|00005280| 68 65 0a 20 20 20 64 61 | 74 61 20 69 74 20 69 73 |he.   da|ta it is|
|00005290| 20 70 72 65 73 65 6e 74 | 65 64 20 77 69 74 68 2c | present|ed with,|
|000052a0| 20 66 69 6e 64 73 20 6f | 75 74 20 61 62 6f 75 74 | finds o|ut about|
|000052b0| 20 73 6f 6d 65 20 6f 66 | 20 74 68 65 20 70 72 6f | some of| the pro|
|000052c0| 70 65 72 74 69 65 73 20 | 6f 66 0a 20 20 20 74 68 |perties |of.   th|
|000052d0| 65 20 64 61 74 61 20 73 | 65 74 20 61 6e 64 20 6c |e data s|et and l|
|000052e0| 65 61 72 6e 73 20 74 6f | 20 72 65 66 6c 65 63 74 |earns to| reflect|
|000052f0| 20 74 68 65 73 65 20 70 | 72 6f 70 65 72 74 69 65 | these p|ropertie|
|00005300| 73 20 69 6e 20 69 74 73 | 20 6f 75 74 70 75 74 2e |s in its| output.|
|00005310| 0a 20 20 20 57 68 61 74 | 20 65 78 61 63 74 6c 79 |.   What| exactly|
|00005320| 20 74 68 65 73 65 20 70 | 72 6f 70 65 72 74 69 65 | these p|ropertie|
|00005330| 73 20 61 72 65 2c 20 74 | 68 61 74 20 74 68 65 20 |s are, t|hat the |
|00005340| 6e 65 74 77 6f 72 6b 20 | 63 61 6e 20 6c 65 61 72 |network |can lear|
|00005350| 6e 20 74 6f 0a 20 20 20 | 72 65 63 6f 67 6e 69 73 |n to.   |recognis|
|00005360| 65 2c 20 64 65 70 65 6e | 64 73 20 6f 6e 20 74 68 |e, depen|ds on th|
|00005370| 65 20 70 61 72 74 69 63 | 75 6c 61 72 20 6e 65 74 |e partic|ular net|
|00005380| 77 6f 72 6b 20 6d 6f 64 | 65 6c 20 61 6e 64 20 6c |work mod|el and l|
|00005390| 65 61 72 6e 69 6e 67 0a | 20 20 20 6d 65 74 68 6f |earning.|   metho|
|000053a0| 64 2e 0a 0a 20 20 20 4d | 61 6e 79 20 6f 66 20 74 |d...   M|any of t|
|000053b0| 68 65 73 65 20 6c 65 61 | 72 6e 69 6e 67 20 6d 65 |hese lea|rning me|
|000053c0| 74 68 6f 64 73 20 61 72 | 65 20 63 6c 6f 73 65 6c |thods ar|e closel|
|000053d0| 79 20 63 6f 6e 6e 65 63 | 74 65 64 20 77 69 74 68 |y connec|ted with|
|000053e0| 20 61 0a 20 20 20 63 65 | 72 74 61 69 6e 20 28 63 | a.   ce|rtain (c|
|000053f0| 6c 61 73 73 20 6f 66 29 | 20 6e 65 74 77 6f 72 6b |lass of)| network|
|00005400| 20 74 6f 70 6f 6c 6f 67 | 79 2e 0a 0a 20 20 20 4e | topolog|y...   N|
|00005410| 6f 77 20 68 65 72 65 20 | 69 73 20 74 68 65 20 6c |ow here |is the l|
|00005420| 69 73 74 2c 20 6a 75 73 | 74 20 67 69 76 69 6e 67 |ist, jus|t giving|
|00005430| 20 73 6f 6d 65 20 6e 61 | 6d 65 73 3a 0a 0a 20 20 | some na|mes:..  |
|00005440| 20 31 2e 20 55 4e 53 55 | 50 45 52 56 49 53 45 44 | 1. UNSU|PERVISED|
|00005450| 20 4c 45 41 52 4e 49 4e | 47 20 28 69 2e 65 2e 20 | LEARNIN|G (i.e. |
|00005460| 77 69 74 68 6f 75 74 20 | 61 20 22 74 65 61 63 68 |without |a "teach|
|00005470| 65 72 22 29 3a 0a 20 20 | 20 20 20 20 20 20 31 29 |er"):.  |      1)|
|00005480| 2e 20 46 65 65 64 62 61 | 63 6b 20 4e 65 74 73 3a |. Feedba|ck Nets:|
|00005490| 0a 20 20 20 20 20 20 20 | 20 20 20 20 61 29 2e 20 |.       |    a). |
|000054a0| 41 64 64 69 74 69 76 65 | 20 47 72 6f 73 73 62 65 |Additive| Grossbe|
|000054b0| 72 67 20 28 41 47 29 0a | 20 20 20 20 20 20 20 20 |rg (AG).|        |
|000054c0| 20 20 20 62 29 2e 20 53 | 68 75 6e 74 69 6e 67 20 |   b). S|hunting |
|000054d0| 47 72 6f 73 73 62 65 72 | 67 20 28 53 47 29 0a 20 |Grossber|g (SG). |
|000054e0| 20 20 20 20 20 20 20 20 | 20 20 63 29 2e 20 42 69 |        |  c). Bi|
|000054f0| 6e 61 72 79 20 41 64 61 | 70 74 69 76 65 20 52 65 |nary Ada|ptive Re|
|00005500| 73 6f 6e 61 6e 63 65 20 | 54 68 65 6f 72 79 20 28 |sonance |Theory (|
|00005510| 41 52 54 31 29 0a 20 20 | 20 20 20 20 20 20 20 20 |ART1).  |        |
|00005520| 20 64 29 2e 20 41 6e 61 | 6c 6f 67 20 41 64 61 70 | d). Ana|log Adap|
|00005530| 74 69 76 65 20 52 65 73 | 6f 6e 61 6e 63 65 20 54 |tive Res|onance T|
|00005540| 68 65 6f 72 79 20 28 41 | 52 54 32 2c 20 41 52 54 |heory (A|RT2, ART|
|00005550| 32 61 29 0a 20 20 20 20 | 20 20 20 20 20 20 20 65 |2a).    |       e|
|00005560| 29 2e 20 44 69 73 63 72 | 65 74 65 20 48 6f 70 66 |). Discr|ete Hopf|
|00005570| 69 65 6c 64 20 28 44 48 | 29 0a 20 20 20 20 20 20 |ield (DH|).      |
|00005580| 20 20 20 20 20 66 29 2e | 20 43 6f 6e 74 69 6e 75 |     f).| Continu|
|00005590| 6f 75 73 20 48 6f 70 66 | 69 65 6c 64 20 28 43 48 |ous Hopf|ield (CH|
|000055a0| 29 0a 20 20 20 20 20 20 | 20 20 20 20 20 67 29 2e |).      |     g).|
|000055b0| 20 44 69 73 63 72 65 74 | 65 20 42 69 64 69 72 65 | Discret|e Bidire|
|000055c0| 63 74 69 6f 6e 61 6c 20 | 41 73 73 6f 63 69 61 74 |ctional |Associat|
|000055d0| 69 76 65 20 4d 65 6d 6f | 72 79 20 28 42 41 4d 29 |ive Memo|ry (BAM)|
|000055e0| 0a 20 20 20 20 20 20 20 | 20 20 20 20 68 29 2e 20 |.       |    h). |
|000055f0| 54 65 6d 70 6f 72 61 6c | 20 41 73 73 6f 63 69 61 |Temporal| Associa|
|00005600| 74 69 76 65 20 4d 65 6d | 6f 72 79 20 28 54 41 4d |tive Mem|ory (TAM|
|00005610| 29 0a 20 20 20 20 20 20 | 20 20 20 20 20 69 29 2e |).      |     i).|
|00005620| 20 41 64 61 70 74 69 76 | 65 20 42 69 64 69 72 65 | Adaptiv|e Bidire|
|00005630| 63 74 69 6f 6e 61 6c 20 | 41 73 73 6f 63 69 61 74 |ctional |Associat|
|00005640| 69 76 65 20 4d 65 6d 6f | 72 79 20 28 41 42 41 4d |ive Memo|ry (ABAM|
|00005650| 29 0a 20 20 20 20 20 20 | 20 20 20 20 20 6a 29 2e |).      |     j).|
|00005660| 20 4b 6f 68 6f 6e 65 6e | 20 53 65 6c 66 2d 6f 72 | Kohonen| Self-or|
|00005670| 67 61 6e 69 7a 69 6e 67 | 20 4d 61 70 2f 54 6f 70 |ganizing| Map/Top|
|00005680| 6f 6c 6f 67 79 2d 70 72 | 65 73 65 72 76 69 6e 67 |ology-pr|eserving|
|00005690| 20 6d 61 70 20 28 53 4f | 4d 2f 54 50 4d 29 0a 20 | map (SO|M/TPM). |
|000056a0| 20 20 20 20 20 20 20 20 | 20 20 6b 29 2e 20 43 6f |        |  k). Co|
|000056b0| 6d 70 65 74 69 74 69 76 | 65 20 6c 65 61 72 6e 69 |mpetitiv|e learni|
|000056c0| 6e 67 0a 20 20 20 20 20 | 20 20 20 32 29 2e 20 46 |ng.     |   2). F|
|000056d0| 65 65 64 66 6f 72 77 61 | 72 64 2d 6f 6e 6c 79 20 |eedforwa|rd-only |
|000056e0| 4e 65 74 73 3a 0a 20 20 | 20 20 20 20 20 20 20 20 |Nets:.  |        |
|000056f0| 20 61 29 2e 20 4c 65 61 | 72 6e 69 6e 67 20 4d 61 | a). Lea|rning Ma|
|00005700| 74 72 69 78 20 28 4c 4d | 29 0a 20 20 20 20 20 20 |trix (LM|).      |
|00005710| 20 20 20 20 20 62 29 2e | 20 44 72 69 76 65 72 2d |     b).| Driver-|
|00005720| 52 65 69 6e 66 6f 72 63 | 65 6d 65 6e 74 20 4c 65 |Reinforc|ement Le|
|00005730| 61 72 6e 69 6e 67 20 28 | 44 52 29 0a 20 20 20 20 |arning (|DR).    |
|00005740| 20 20 20 20 20 20 20 63 | 29 2e 20 4c 69 6e 65 61 |       c|). Linea|
|00005750| 72 20 41 73 73 6f 63 69 | 61 74 69 76 65 20 4d 65 |r Associ|ative Me|
|00005760| 6d 6f 72 79 20 28 4c 41 | 4d 29 0a 20 20 20 20 20 |mory (LA|M).     |
|00005770| 20 20 20 20 20 20 64 29 | 2e 20 4f 70 74 69 6d 61 |      d)|. Optima|
|00005780| 6c 20 4c 69 6e 65 61 72 | 20 41 73 73 6f 63 69 61 |l Linear| Associa|
|00005790| 74 69 76 65 20 4d 65 6d | 6f 72 79 20 28 4f 4c 41 |tive Mem|ory (OLA|
|000057a0| 4d 29 0a 20 20 20 20 20 | 20 20 20 20 20 20 65 29 |M).     |      e)|
|000057b0| 2e 20 53 70 61 72 73 65 | 20 44 69 73 74 72 69 62 |. Sparse| Distrib|
|000057c0| 75 74 65 64 20 41 73 73 | 6f 63 69 61 74 69 76 65 |uted Ass|ociative|
|000057d0| 20 4d 65 6d 6f 72 79 20 | 28 53 44 4d 29 0a 20 20 | Memory |(SDM).  |
|000057e0| 20 20 20 20 20 20 20 20 | 20 66 29 2e 20 46 75 7a |        | f). Fuz|
|000057f0| 7a 79 20 41 73 73 6f 63 | 69 61 74 69 76 65 20 4d |zy Assoc|iative M|
|00005800| 65 6d 6f 72 79 20 28 46 | 41 4d 29 0a 20 20 20 20 |emory (F|AM).    |
|00005810| 20 20 20 20 20 20 20 67 | 29 2e 20 43 6f 75 6e 74 |       g|). Count|
|00005820| 65 72 70 72 6f 67 61 74 | 69 6f 6e 20 28 43 50 4e |erprogat|ion (CPN|
|00005830| 29 0a 0a 20 20 20 32 2e | 20 53 55 50 45 52 56 49 |)..   2.| SUPERVI|
|00005840| 53 45 44 20 4c 45 41 52 | 4e 49 4e 47 20 28 69 2e |SED LEAR|NING (i.|
|00005850| 65 2e 20 77 69 74 68 20 | 61 20 22 74 65 61 63 68 |e. with |a "teach|
|00005860| 65 72 22 29 3a 0a 20 20 | 20 20 20 20 20 20 31 29 |er"):.  |      1)|
|00005870| 2e 20 46 65 65 64 62 61 | 63 6b 20 4e 65 74 73 3a |. Feedba|ck Nets:|
|00005880| 0a 20 20 20 20 20 20 20 | 20 20 20 20 61 29 2e 20 |.       |    a). |
|00005890| 42 72 61 69 6e 2d 53 74 | 61 74 65 2d 69 6e 2d 61 |Brain-St|ate-in-a|
|000058a0| 2d 42 6f 78 20 28 42 53 | 42 29 0a 20 20 20 20 20 |-Box (BS|B).     |
|000058b0| 20 20 20 20 20 20 62 29 | 2e 20 46 75 7a 7a 79 20 |      b)|. Fuzzy |
|000058c0| 43 6f 6e 67 69 74 69 76 | 65 20 4d 61 70 20 28 46 |Congitiv|e Map (F|
|000058d0| 43 4d 29 0a 20 20 20 20 | 20 20 20 20 20 20 20 63 |CM).    |       c|
|000058e0| 29 2e 20 42 6f 6c 74 7a | 6d 61 6e 6e 20 4d 61 63 |). Boltz|mann Mac|
|000058f0| 68 69 6e 65 20 28 42 4d | 29 0a 20 20 20 20 20 20 |hine (BM|).      |
|00005900| 20 20 20 20 20 64 29 2e | 20 4d 65 61 6e 20 46 69 |     d).| Mean Fi|
|00005910| 65 6c 64 20 41 6e 6e 65 | 61 6c 69 6e 67 20 28 4d |eld Anne|aling (M|
|00005920| 46 54 29 0a 20 20 20 20 | 20 20 20 20 20 20 20 65 |FT).    |       e|
|00005930| 29 2e 20 52 65 63 75 72 | 72 65 6e 74 20 43 61 73 |). Recur|rent Cas|
|00005940| 63 61 64 65 20 43 6f 72 | 72 65 6c 61 74 69 6f 6e |cade Cor|relation|
|00005950| 20 28 52 43 43 29 0a 20 | 20 20 20 20 20 20 20 20 | (RCC). |        |
|00005960| 20 20 66 29 2e 20 4c 65 | 61 72 6e 69 6e 67 20 56 |  f). Le|arning V|
|00005970| 65 63 74 6f 72 20 51 75 | 61 6e 74 69 7a 61 74 69 |ector Qu|antizati|
|00005980| 6f 6e 20 28 4c 56 51 29 | 0a 20 20 20 20 20 20 20 |on (LVQ)|.       |
|00005990| 20 20 20 20 67 29 2e 20 | 42 61 63 6b 70 72 6f 70 |    g). |Backprop|
|000059a0| 61 67 61 74 69 6f 6e 20 | 74 68 72 6f 75 67 68 20 |agation |through |
|000059b0| 74 69 6d 65 20 28 42 50 | 54 54 29 0a 20 20 20 20 |time (BP|TT).    |
|000059c0| 20 20 20 20 20 20 20 68 | 29 2e 20 52 65 61 6c 2d |       h|). Real-|
|000059d0| 74 69 6d 65 20 72 65 63 | 75 72 72 65 6e 74 20 6c |time rec|urrent l|
|000059e0| 65 61 72 6e 69 6e 67 20 | 28 52 54 52 4c 29 0a 20 |earning |(RTRL). |
|000059f0| 20 20 20 20 20 20 20 20 | 20 20 69 29 2e 20 52 65 |        |  i). Re|
|00005a00| 63 75 72 72 65 6e 74 20 | 45 78 74 65 6e 64 65 64 |current |Extended|
|00005a10| 20 4b 61 6c 6d 61 6e 20 | 46 69 6c 74 65 72 20 28 | Kalman |Filter (|
|00005a20| 45 4b 46 29 0a 20 20 20 | 20 20 20 20 20 32 29 2e |EKF).   |     2).|
|00005a30| 20 46 65 65 64 66 6f 72 | 77 61 72 64 2d 6f 6e 6c | Feedfor|ward-onl|
|00005a40| 79 20 4e 65 74 73 3a 0a | 20 20 20 20 20 20 20 20 |y Nets:.|        |
|00005a50| 20 20 20 61 29 2e 20 50 | 65 72 63 65 70 74 72 6f |   a). P|erceptro|
|00005a60| 6e 0a 20 20 20 20 20 20 | 20 20 20 20 20 62 29 2e |n.      |     b).|
|00005a70| 20 41 64 61 6c 69 6e 65 | 2c 20 4d 61 64 61 6c 69 | Adaline|, Madali|
|00005a80| 6e 65 0a 20 20 20 20 20 | 20 20 20 20 20 20 63 29 |ne.     |      c)|
|00005a90| 2e 20 42 61 63 6b 70 72 | 6f 70 61 67 61 74 69 6f |. Backpr|opagatio|
|00005aa0| 6e 20 28 42 50 29 0a 20 | 20 20 20 20 20 20 20 20 |n (BP). |        |
|00005ab0| 20 20 64 29 2e 20 43 61 | 75 63 68 79 20 4d 61 63 |  d). Ca|uchy Mac|
|00005ac0| 68 69 6e 65 20 28 43 4d | 29 0a 20 20 20 20 20 20 |hine (CM|).      |
|00005ad0| 20 20 20 20 20 65 29 2e | 20 41 64 61 70 74 69 76 |     e).| Adaptiv|
|00005ae0| 65 20 48 65 75 72 69 73 | 74 69 63 20 43 72 69 74 |e Heuris|tic Crit|
|00005af0| 69 63 20 28 41 48 43 29 | 0a 20 20 20 20 20 20 20 |ic (AHC)|.       |
|00005b00| 20 20 20 20 66 29 2e 20 | 54 69 6d 65 20 44 65 6c |    f). |Time Del|
|00005b10| 61 79 20 4e 65 75 72 61 | 6c 20 4e 65 74 77 6f 72 |ay Neura|l Networ|
|00005b20| 6b 20 28 54 44 4e 4e 29 | 0a 20 20 20 20 20 20 20 |k (TDNN)|.       |
|00005b30| 20 20 20 20 67 29 2e 20 | 41 73 73 6f 63 69 61 74 |    g). |Associat|
|00005b40| 69 76 65 20 52 65 77 61 | 72 64 20 50 65 6e 61 6c |ive Rewa|rd Penal|
|00005b50| 74 79 20 28 41 52 50 29 | 0a 20 20 20 20 20 20 20 |ty (ARP)|.       |
|00005b60| 20 20 20 20 68 29 2e 20 | 41 76 61 6c 61 6e 63 68 |    h). |Avalanch|
|00005b70| 65 20 4d 61 74 63 68 65 | 64 20 46 69 6c 74 65 72 |e Matche|d Filter|
|00005b80| 20 28 41 4d 46 29 0a 20 | 20 20 20 20 20 20 20 20 | (AMF). |        |
|00005b90| 20 20 69 29 2e 20 42 61 | 63 6b 70 65 72 63 6f 6c |  i). Ba|ckpercol|
|00005ba0| 61 74 69 6f 6e 20 28 50 | 65 72 63 29 0a 20 20 20 |ation (P|erc).   |
|00005bb0| 20 20 20 20 20 20 20 20 | 6a 29 2e 20 41 72 74 6d |        |j). Artm|
|00005bc0| 61 70 0a 20 20 20 20 20 | 20 20 20 20 20 20 6b 29 |ap.     |      k)|
|00005bd0| 2e 20 41 64 61 70 74 69 | 76 65 20 4c 6f 67 69 63 |. Adapti|ve Logic|
|00005be0| 20 4e 65 74 77 6f 72 6b | 20 28 41 4c 4e 29 0a 20 | Network| (ALN). |
|00005bf0| 20 20 20 20 20 20 20 20 | 20 20 6c 29 2e 20 43 61 |        |  l). Ca|
|00005c00| 73 63 61 64 65 20 43 6f | 72 72 65 6c 61 74 69 6f |scade Co|rrelatio|
|00005c10| 6e 20 28 43 61 73 43 6f | 72 29 0a 20 20 20 20 20 |n (CasCo|r).     |
|00005c20| 20 20 20 20 20 20 6d 29 | 2e 20 45 78 74 65 6e 64 |      m)|. Extend|
|00005c30| 65 64 20 4b 61 6c 6d 61 | 6e 20 46 69 6c 74 65 72 |ed Kalma|n Filter|
|00005c40| 28 45 4b 46 29 0a 0a 20 | 20 20 2d 2d 2d 2d 2d 2d |(EKF).. |  ------|
|00005c50| 2d 2d 2d 2d 2d 2d 2d 2d | 2d 2d 2d 2d 2d 2d 2d 2d |--------|--------|
|00005c60| 2d 2d 2d 2d 2d 2d 2d 2d | 2d 2d 2d 2d 2d 2d 2d 2d |--------|--------|
|00005c70| 2d 2d 2d 2d 2d 2d 2d 2d | 2d 2d 2d 2d 2d 2d 2d 2d |--------|--------|
|00005c80| 2d 2d 2d 2d 2d 2d 2d 2d | 2d 2d 2d 2d 2d 2d 2d 2d |--------|--------|
|00005c90| 2d 2d 0a 0a 20 39 2e 20 | 41 3a 20 57 68 61 74 20 |--.. 9. |A: What |
|00005ca0| 61 62 6f 75 74 20 47 65 | 6e 65 74 69 63 20 41 6c |about Ge|netic Al|
|00005cb0| 67 6f 72 69 74 68 6d 73 | 3f 0a 20 3d 3d 3d 3d 3d |gorithms|?. =====|
|00005cc0| 3d 3d 3d 3d 3d 3d 3d 3d | 3d 3d 3d 3d 3d 3d 3d 3d |========|========|
|00005cd0| 3d 3d 3d 3d 3d 3d 3d 3d | 3d 3d 3d 3d 3d 3d 3d 0a |========|=======.|
|00005ce0| 0a 20 20 20 54 68 65 72 | 65 20 61 72 65 20 61 20 |.   Ther|e are a |
|00005cf0| 6e 75 6d 62 65 72 20 6f | 66 20 64 65 66 69 6e 69 |number o|f defini|
|00005d00| 74 69 6f 6e 73 20 6f 66 | 20 47 41 20 28 47 65 6e |tions of| GA (Gen|
|00005d10| 65 74 69 63 20 41 6c 67 | 6f 72 69 74 68 6d 29 2e |etic Alg|orithm).|
|00005d20| 20 41 0a 20 20 20 70 6f | 73 73 69 62 6c 65 20 6f | A.   po|ssible o|
|00005d30| 6e 65 20 69 73 0a 0a 20 | 20 20 20 20 41 20 47 41 |ne is.. |    A GA|
|00005d40| 20 69 73 20 61 6e 20 6f | 70 74 69 6d 69 7a 61 74 | is an o|ptimizat|
|00005d50| 69 6f 6e 20 70 72 6f 67 | 72 61 6d 0a 20 20 20 20 |ion prog|ram.    |
|00005d60| 20 74 68 61 74 20 73 74 | 61 72 74 73 20 77 69 74 | that st|arts wit|
|00005d70| 68 20 0a 20 20 20 20 20 | 61 20 70 6f 70 75 6c 61 |h .     |a popula|
|00005d80| 74 69 6f 6e 20 6f 66 20 | 65 6e 63 6f 64 65 64 20 |tion of |encoded |
|00005d90| 70 72 6f 63 65 64 75 72 | 65 73 2c 20 20 20 20 20 |procedur|es,     |
|00005da0| 20 20 28 43 72 65 61 74 | 69 6f 6e 20 6f 66 20 4c |  (Creat|ion of L|
|00005db0| 69 66 65 20 3a 2d 3e 20 | 29 0a 20 20 20 20 20 6d |ife :-> |).     m|
|00005dc0| 75 74 61 74 65 73 20 74 | 68 65 6d 20 73 74 6f 63 |utates t|hem stoc|
|00005dd0| 68 61 73 74 69 63 61 6c | 6c 79 2c 20 20 20 20 20 |hastical|ly,     |
|00005de0| 20 20 20 20 20 20 20 20 | 20 28 47 65 74 20 63 61 |        | (Get ca|
|00005df0| 6e 63 65 72 20 6f 72 20 | 73 6f 20 3a 2d 3e 20 29 |ncer or |so :-> )|
|00005e00| 0a 20 20 20 20 20 61 6e | 64 20 75 73 65 73 20 61 |.     an|d uses a|
|00005e10| 20 73 65 6c 65 63 74 69 | 6f 6e 20 70 72 6f 63 65 | selecti|on proce|
|00005e20| 73 73 20 20 20 20 20 20 | 20 20 20 20 20 20 20 20 |ss      |        |
|00005e30| 28 44 61 72 77 69 6e 69 | 73 6d 29 0a 20 20 20 20 |(Darwini|sm).    |
|00005e40| 20 74 6f 20 70 72 65 66 | 65 72 20 74 68 65 20 6d | to pref|er the m|
|00005e50| 75 74 61 6e 74 73 20 77 | 69 74 68 20 68 69 67 68 |utants w|ith high|
|00005e60| 20 66 69 74 6e 65 73 73 | 0a 20 20 20 20 20 61 6e | fitness|.     an|
|00005e70| 64 20 70 65 72 68 61 70 | 73 20 61 20 72 65 63 6f |d perhap|s a reco|
|00005e80| 6d 62 69 6e 61 74 69 6f | 6e 20 70 72 6f 63 65 73 |mbinatio|n proces|
|00005e90| 73 20 20 20 20 20 20 20 | 28 4d 61 6b 65 20 62 61 |s       |(Make ba|
|00005ea0| 62 69 65 73 20 3a 2d 3e | 20 29 0a 20 20 20 20 20 |bies :->| ).     |
|00005eb0| 74 6f 20 63 6f 6d 62 69 | 6e 65 20 70 72 6f 70 65 |to combi|ne prope|
|00005ec0| 72 74 69 65 73 20 6f 66 | 20 28 70 72 65 66 65 72 |rties of| (prefer|
|00005ed0| 61 62 6c 79 29 20 74 68 | 65 20 73 75 63 63 65 73 |ably) th|e succes|
|00005ee0| 66 75 6c 20 6d 75 74 61 | 6e 74 73 2e 0a 0a 20 20 |ful muta|nts...  |
|00005ef0| 20 47 65 6e 65 74 69 63 | 20 41 6c 67 6f 72 69 74 | Genetic| Algorit|
|00005f00| 68 6d 73 20 61 72 65 20 | 6a 75 73 74 20 61 20 73 |hms are |just a s|
|00005f10| 70 65 63 69 61 6c 20 63 | 61 73 65 20 6f 66 20 74 |pecial c|ase of t|
|00005f20| 68 65 20 6d 6f 72 65 20 | 67 65 6e 65 72 61 6c 20 |he more |general |
|00005f30| 69 64 65 61 0a 20 20 20 | 6f 66 20 60 60 65 76 6f |idea.   |of ``evo|
|00005f40| 6c 75 74 69 6f 6e 61 72 | 79 20 63 6f 6d 70 75 74 |lutionar|y comput|
|00005f50| 61 74 69 6f 6e 27 27 2e | 20 54 68 65 72 65 20 69 |ation''.| There i|
|00005f60| 73 20 61 20 6e 65 77 73 | 67 72 6f 75 70 20 74 68 |s a news|group th|
|00005f70| 61 74 20 69 73 0a 20 20 | 20 64 65 64 69 63 61 74 |at is.  | dedicat|
|00005f80| 65 64 20 74 6f 20 74 68 | 65 20 66 69 65 6c 64 20 |ed to th|e field |
|00005f90| 6f 66 20 65 76 6f 6c 75 | 74 69 6f 6e 61 72 79 20 |of evolu|tionary |
|00005fa0| 63 6f 6d 70 75 74 61 74 | 69 6f 6e 20 63 61 6c 6c |computat|ion call|
|00005fb0| 65 64 0a 20 20 20 63 6f | 6d 70 2e 61 69 2e 67 65 |ed.   co|mp.ai.ge|
|00005fc0| 6e 65 74 69 63 2e 20 49 | 74 20 68 61 73 20 61 20 |netic. I|t has a |
|00005fd0| 64 65 74 61 69 6c 65 64 | 20 46 41 51 20 70 6f 73 |detailed| FAQ pos|
|00005fe0| 74 69 6e 67 20 77 68 69 | 63 68 2c 20 66 6f 72 20 |ting whi|ch, for |
|00005ff0| 69 6e 73 74 61 6e 63 65 | 2c 0a 20 20 20 65 78 70 |instance|,.   exp|
|00006000| 6c 61 69 6e 73 20 74 68 | 65 20 74 65 72 6d 73 20 |lains th|e terms |
|00006010| 22 47 65 6e 65 74 69 63 | 20 41 6c 67 6f 72 69 74 |"Genetic| Algorit|
|00006020| 68 6d 22 2c 20 22 45 76 | 6f 6c 75 74 69 6f 6e 61 |hm", "Ev|olutiona|
|00006030| 72 79 0a 20 20 20 50 72 | 6f 67 72 61 6d 6d 69 6e |ry.   Pr|ogrammin|
|00006040| 67 22 2c 20 22 45 76 6f | 6c 75 74 69 6f 6e 20 53 |g", "Evo|lution S|
|00006050| 74 72 61 74 65 67 79 22 | 2c 20 22 43 6c 61 73 73 |trategy"|, "Class|
|00006060| 69 66 69 65 72 20 53 79 | 73 74 65 6d 22 2c 20 61 |ifier Sy|stem", a|
|00006070| 6e 64 0a 20 20 20 22 47 | 65 6e 65 74 69 63 20 50 |nd.   "G|enetic P|
|00006080| 72 6f 67 72 61 6d 6d 69 | 6e 67 22 2e 20 54 68 61 |rogrammi|ng". Tha|
|00006090| 74 20 46 41 51 20 61 6c | 73 6f 20 63 6f 6e 74 61 |t FAQ al|so conta|
|000060a0| 69 6e 73 20 6c 6f 74 73 | 20 6f 66 20 70 6f 69 6e |ins lots| of poin|
|000060b0| 74 65 72 73 0a 20 20 20 | 74 6f 20 72 65 6c 65 76 |ters.   |to relev|
|000060c0| 61 6e 74 20 6c 69 74 65 | 72 61 74 75 72 65 2c 20 |ant lite|rature, |
|000060d0| 73 6f 66 74 77 61 72 65 | 2c 20 6f 74 68 65 72 20 |software|, other |
|000060e0| 73 6f 75 72 63 65 73 20 | 6f 66 20 69 6e 66 6f 72 |sources |of infor|
|000060f0| 6d 61 74 69 6f 6e 2c 20 | 65 74 0a 20 20 20 63 65 |mation, |et.   ce|
|00006100| 74 65 72 61 20 65 74 20 | 63 65 74 65 72 61 2e 20 |tera et |cetera. |
|00006110| 50 6c 65 61 73 65 20 73 | 65 65 20 74 68 65 20 63 |Please s|ee the c|
|00006120| 6f 6d 70 2e 61 69 2e 67 | 65 6e 65 74 69 63 20 46 |omp.ai.g|enetic F|
|00006130| 41 51 20 66 6f 72 20 66 | 75 72 74 68 65 72 0a 20 |AQ for f|urther. |
|00006140| 20 20 69 6e 66 6f 72 6d | 61 74 69 6f 6e 2e 20 0a |  inform|ation. .|
|00006150| 0a 20 20 20 2d 2d 2d 2d | 2d 2d 2d 2d 2d 2d 2d 2d |.   ----|--------|
|00006160| 2d 2d 2d 2d 2d 2d 2d 2d | 2d 2d 2d 2d 2d 2d 2d 2d |--------|--------|
|00006170| 2d 2d 2d 2d 2d 2d 2d 2d | 2d 2d 2d 2d 2d 2d 2d 2d |--------|--------|
|00006180| 2d 2d 2d 2d 2d 2d 2d 2d | 2d 2d 2d 2d 2d 2d 2d 2d |--------|--------|
|00006190| 2d 2d 2d 2d 2d 2d 2d 2d | 2d 2d 2d 2d 0a 0a 31 30 |--------|----..10|
|000061a0| 2e 20 41 3a 20 57 68 61 | 74 20 61 62 6f 75 74 20 |. A: Wha|t about |
|000061b0| 46 75 7a 7a 79 20 4c 6f | 67 69 63 3f 0a 3d 3d 3d |Fuzzy Lo|gic?.===|
|000061c0| 3d 3d 3d 3d 3d 3d 3d 3d | 3d 3d 3d 3d 3d 3d 3d 3d |========|========|
|000061d0| 3d 3d 3d 3d 3d 3d 3d 3d | 3d 3d 3d 0a 0a 20 20 20 |========|===..   |
|000061e0| 46 75 7a 7a 79 20 4c 6f | 67 69 63 20 69 73 20 61 |Fuzzy Lo|gic is a|
|000061f0| 6e 20 61 72 65 61 20 6f | 66 20 72 65 73 65 61 72 |n area o|f resear|
|00006200| 63 68 20 62 61 73 65 64 | 20 6f 6e 20 74 68 65 20 |ch based| on the |
|00006210| 77 6f 72 6b 20 6f 66 20 | 4c 2e 41 2e 0a 20 20 20 |work of |L.A..   |
|00006220| 5a 61 64 65 68 2e 20 49 | 74 20 69 73 20 61 20 64 |Zadeh. I|t is a d|
|00006230| 65 70 61 72 74 75 72 65 | 20 66 72 6f 6d 20 63 6c |eparture| from cl|
|00006240| 61 73 73 69 63 61 6c 20 | 74 77 6f 2d 76 61 6c 75 |assical |two-valu|
|00006250| 65 64 20 73 65 74 73 20 | 61 6e 64 20 6c 6f 67 69 |ed sets |and logi|
|00006260| 63 2c 0a 20 20 20 74 68 | 61 74 20 75 73 65 73 20 |c,.   th|at uses |
|00006270| 22 73 6f 66 74 22 20 6c | 69 6e 67 75 69 73 74 69 |"soft" l|inguisti|
|00006280| 63 20 28 65 2e 67 2e 20 | 6c 61 72 67 65 2c 20 68 |c (e.g. |large, h|
|00006290| 6f 74 2c 20 74 61 6c 6c | 29 20 73 79 73 74 65 6d |ot, tall|) system|
|000062a0| 20 76 61 72 69 61 62 6c | 65 73 20 61 6e 64 0a 20 | variabl|es and. |
|000062b0| 20 20 61 20 63 6f 6e 74 | 69 6e 75 6f 75 73 20 72 |  a cont|inuous r|
|000062c0| 61 6e 67 65 20 6f 66 20 | 74 72 75 74 68 20 76 61 |ange of |truth va|
|000062d0| 6c 75 65 73 20 69 6e 20 | 74 68 65 20 69 6e 74 65 |lues in |the inte|
|000062e0| 72 76 61 6c 20 5b 30 2c | 31 5d 2c 20 72 61 74 68 |rval [0,|1], rath|
|000062f0| 65 72 0a 20 20 20 74 68 | 61 6e 20 73 74 72 69 63 |er.   th|an stric|
|00006300| 74 20 62 69 6e 61 72 79 | 20 28 54 72 75 65 20 6f |t binary| (True o|
|00006310| 72 20 46 61 6c 73 65 29 | 20 64 65 63 69 73 69 6f |r False)| decisio|
|00006320| 6e 73 20 61 6e 64 20 61 | 73 73 69 67 6e 6d 65 6e |ns and a|ssignmen|
|00006330| 74 73 2e 0a 0a 20 20 20 | 46 75 7a 7a 79 20 6c 6f |ts...   |Fuzzy lo|
|00006340| 67 69 63 20 69 73 20 75 | 73 65 64 20 77 68 65 72 |gic is u|sed wher|
|00006350| 65 20 61 20 73 79 73 74 | 65 6d 20 69 73 20 64 69 |e a syst|em is di|
|00006360| 66 66 69 63 75 6c 74 20 | 74 6f 20 6d 6f 64 65 6c |fficult |to model|
|00006370| 20 65 78 61 63 74 6c 79 | 0a 20 20 20 28 62 75 74 | exactly|.   (but|
|00006380| 20 61 6e 20 69 6e 65 78 | 61 63 74 20 6d 6f 64 65 | an inex|act mode|
|00006390| 6c 20 69 73 20 61 76 61 | 69 6c 61 62 6c 65 29 2c |l is ava|ilable),|
|000063a0| 20 69 73 20 63 6f 6e 74 | 72 6f 6c 6c 65 64 20 62 | is cont|rolled b|
|000063b0| 79 20 61 20 68 75 6d 61 | 6e 0a 20 20 20 6f 70 65 |y a huma|n.   ope|
|000063c0| 72 61 74 6f 72 20 6f 72 | 20 65 78 70 65 72 74 2c |rator or| expert,|
|000063d0| 20 6f 72 20 77 68 65 72 | 65 20 61 6d 62 69 67 75 | or wher|e ambigu|
|000063e0| 69 74 79 20 6f 72 20 76 | 61 67 75 65 6e 65 73 73 |ity or v|agueness|
|000063f0| 20 69 73 20 63 6f 6d 6d | 6f 6e 2e 20 41 0a 20 20 | is comm|on. A.  |
+--------+-------------------------+-------------------------+--------+--------+